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Preface 


The book contains the construction, implementation, and application of commonly 
used methods in the solution of Initial Value Problems (IVPs). 

Along the years, within the groups I have worked with, we have seen the 
need to teach the theory and practice of numerical methods to graduate students, 
who are very strong in science but not so strong in programing or computer 
science. Personalized tutorials and small group workshops have been the common 
solution, where it is possible to revise the theory and implement programs hands- 
on. This book is intended to provide these two ingredients, theory and immediate 
implementation. 

The chapters are organized from simple to difficult, starting with IVPs involving 
Ordinary Differential Equations (ODEs), followed by problems with Partial Differ- 
ential Equations (PDEs) on a domain with 1+1 dimensions and finally problems 
with PDEs in 3+1 dimensions. 

Examples and applications of IVPs associated to ODEs intend to cover various 
fields of science, including simple models of population, chaos, celestial mechanics, 
and astrophysics. Models and applications are expected to seed the motivation 
to continue along state of the art problems. The examples concerning PDEs 
concentrate on Wave, Schrédinger, Diffusion, and Fluid Dynamics equations, which 
are common to a variety of disciplines, for example electromagnetism, diffusion 
problems in chemistry or ecology, quantum mechanics or atomic gases, and all sorts 
of problems involving simple fluids in astrophysics or the laboratory. 

At the end of each chapter, there is a brief description of how the methods can 
improve, along with one or two projects that can be developed with the methods 
and codes described. The type of projects would reflect my inclination toward space 
physics, explained by my academic origins centered in Numerical Relativity. 

Of special importance nowadays, when Machine Learning (ML) and Artificial 
Intelligence (AI) methods shine, useful to solve inverse problems using causal 
inference, it is essential to keep in mind that direct problems are essential to train and 
validate ML and AI programs. This book contains a collection of direct problems, 
along with the methods and codes to solve them, that can be connected to interesting 
inverse problems. 


viii Preface 


The numerical methods in the book were selected because it is possible to solve 
a considerable variety of problems of various sorts. More specifically, the IVPs are 
solved on a discrete version of the domain of solution, and therefore the methods of 
solution are based on Finite Differences and Finite Volumes approaches. 

The implementation of the methods described in the text is explained with 
fortran 90 language, which is nearly a literal formula translation. Moreover, 
fortran 90 is nearly as easy to program as python and nearly as efficient as c or 
c++ in most of architecture-compiler combinations. In summary, fortran 90 
allows to straightforwardly translate the ideas in the text into a program, and that 
is the reason why the codes included to reproduce the results in the book use this 
language. As supplementary material, we also include the c++ version of the codes 
for the readers more used to this language. For the analysis, the output is plain 
ascii that can we viewed with most data visualizers, and we provide instructions for 
gnuplot. 

Hopefully this text, written at the action field, will help the reader to start solving 
state of the art problems. 


Morelia, Mexico Francisco S. Guzman 
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Chapter 1 A 
Introduction FECA 


Abstract The solution of Initial Value Problems (IVPs) in various branches of 
science has become essential in recent years. Models of evolution are used in 
most disciplines, social sciences, economy, biology, chemistry, geophysics, space 
sciences, and physics in general to mention a few. These problems are defined in 
terms of a Differential Equations (DEs) that describe the evolution of properties 
of a given system, for example, population densities, risk estimates, spread of 
species and diseases, diffusion of substances in mixtures, prediction of atmospheric 
currents, space weather processes, quantum and classical problems, and more. 


The solution of Initial Value Problems in various branches of science has become 
essential in recent years. Models of evolution are used in most disciplines, social 
sciences, economy, biology, chemistry, geophysics, space sciences, and physics in 
general to mention a few. These problems are defined in terms of a Differential 
Equations that describe the evolution of properties of a given system, for example, 
population densities, risk estimates, spread of species and diseases, diffusion of 
substances in mixtures, prediction of atmospheric currents, space weather processes, 
quantum and classical problems, and more. 

This type of problem is defined with one or various Differential Equations 
(DEs), Ordinary (ODEs) in the time domain or partial (PDEs) on a spatial-temporal 
domain. The objective is the construction of the solution to the equations for given 
initial and boundary conditions. 

Existence and uniqueness of solutions to these problems are guaranteed provided 
some mathematical conditions of the equations related to a given Initial Value 
Problem (IVP), for example, initial conditions and the parameters in the equations. 
Once these properties are known one can search for a solution, either in closed or 
numerical form. The closed form is a formula that expresses the solution. In contrast, 
numerical solutions are approximations to a possibly existing closed solution, in 
most cases calculated in a limited domain. In this sense numerical solutions are 
modest in comparison with exact closed solutions. 

Also in many cases, an IVP is formulated in an unbounded domain along spatial 
and temporal directions, while most numerical solutions can only be calculated in 
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a limited chunk of space during a finite time window. The calculation of numerical 
solutions demand from us the appropriate spatial and temporal domain selection, 
where the solution can be interesting. 

One commonly frustrating aspect of numerical solutions is that while closed 
solutions are contained in mathematical expressions, numerical solutions in the best 
case are presented as a collection of data and sometimes within plots. Even so, 
numerical solutions are valuable because they can be constructed for differential 
equations whose exact solutions are unknown. 

The name IVP indicates that the solution is needed for a scenario whose 
initial conditions are known. Initial time is a space-like boundary where boundary 
conditions are imposed to start an evolution, whose result will be the solution in the 
whole domain that includes time-like boundaries. Implicitly the solution of an IVP 
is a process of evolution, evolution of the initial conditions imposed on the unknown 
functions of the DEs. 


Evolution. The idea of evolution of initial conditions helps to imagine how the 
solution is constructed in time. Biological evolution is the best evidence that 
information is transmitted from one generation to the next. In the same manner, the 
evolution of initial data transmits information along the time domain the values of an 
unknown in the future with evolution rules governed not by natural selection but by 
the DEs that model a process. The numerical solution of IVPs is constructed during 
a discrete time domain, like biological evolution from generation to generation, in 
this case step by step in terms of the solution at the previous time. 


The type of IVPs we use to illustrate the methods involving PDEs define a space- 
time domain of solution. We solve hyperbolic equations, specifically wave-like 
equations and locally hyperbolic problems associated to hydrodynamics, as well as 
parabolic type equations, that include diffusion, reaction-diffusion processes and 
Schródinger equation. 


1.1 Errors and Precision of Numbers 


Nature of Approximate Solutions. The construction of numerical solutions, inde- 
pendently of the numerical method to be used, intrinsically carry an approximation 
to the functions or derivative operators in the DEs. An error is to be expected from 
origin, by concept of approximation. In calculations done with a computer, errors 
are eventually unavoidable, while the closed exact solution of an IVP is represented 
with a formula that one can evaluate with arbitrary precision. 


Various types of errors are present in the numerical solution of an IVP. Essential 
to all combinations of compiler-architecture is the round-off error. Since numbers 
can be represented only up to a certain accuracy, numbers are rounded. This error is 
defined as the difference between the number we would like to use in a calculation 
and the one used; for a simplistic example, assume we would like to use the number 
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1.66 and the computer represents its value by 1.7, rounded to the closest version, 
and then the round-off error is —0.04. 

Modern computers though can handle a bigger number of digits and therefore 
the round off error in the representation of a number is smaller. For example 
the number 1/3, calculated using numbers 1.0 and 3.0 using single, double, 
and quadruple precision, is respectively 0.333333343, 0.33333333333333331, and 
0.333333333333333333333333333333333317, on a given 64 bits computer and 
using the gfortran compiler. 

Arithmetic operations between these numbers propagate the errors, and the 
numerical solution of IVPs is based in the considerable calculation of arithmetic 
operations with rounded numbers which damages the quality of numeric approx- 
imations. Considering the experience in the representation of the number above, 
the propagation of the round-off error expands, for example, the number 1 . š 
is represented in various ways depending on the precision used to define the 
numbers 1,7,8,3. Respectively, the product is 0.380952388, 0.38095238095238093, 
and 0.380952380952380952380952380952380934 when using single, double, and 
quadruple precision. In the latter case the cyclic pattern of the number is better seen, 
while in the first two cases truncation prevents it. 

Round-off errors are intrinsic to representations with different precision; they 
propagate along with arithmetic operations and are unavoidable. The best one can do 
is to use the higher precision allowed by the compiler-architecture combination used 
and maintain these errors below the errors due to the numerical methods used 
to implement a numerical solution. In the worst-case scenario, a balance between 
hardware capacity and precision is desirable, and this is the reason why in the book 
we assume that the compiler-processor combination allows the representation of 
real numbers with double precision. 

The errors due to numerical methods are truncation errors. Numerical methods 
can only construct approximate solutions of IVPs, and the source of this kind of 
error is that the problem solved is only and approximated version of the original 
one. Different methods approximate better the equations of an IVP, and the better 
the approximation, the smaller the error. In Chapter 1 we describe in detail error 
estimates due to truncation errors and how they propagate in time. Truncation error 
serves to determine the consistency and convergence of numerical solutions and is 
key to calibrate their validity. 

Notice finally that during the evolution of given initial conditions, the successive 
arithmetic operations involving rounded numbers, that on top carry truncation errors 
due to numerical methods, that errors propagate along the spatial direction at a 
fixed time, and that later on they are transmitted over time. Despite all these 
inconveniences, it is possible to construct reliable numerical solutions to IVP as 
will be clear with worked examples. 
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1.3 Rescaling Equations 


It is possible to reduce the truncation errors when some coefficients in equations 
can be absorbed in the variables and leave the equations with coefficients easy to 
represent. One typical example is Schródinger equation: 


ow haw an, 
ih— = +VW, (1.1) 
ot Om Fra 


where YW = vi, f) is the wave function, fi is Planck's constant, and m is the mass 
of the particle to be described, which is subject to the effects of the potential V. 
Rescaling variables and functions with the definitions 


DEM m, m, V 
WwW=—-—W, x= —x, t= —t, V = —, (1.2) 
m h h m 
Equation (1.1) is transformed into 
aw 129? 
i— = ————— + Vw, 1.3 
$a za" 2) 


for V = V (x, t), which is a more comfortable equation to deal with. It also helps 
reducing the sources of round-off error, for example, if the particle is the electron, 
then m = 9.1093837 x 10 ?!kg = 0.51099895MeV-c ?, while Planck's constant 
is h = 1.054571817... x 10-*4J-s = 6.582119569... x 1077 MeV's. In either of 
the two unit systems, it is simpler to use the Mig M in the first term of the 


scaled equation than that of the original equation 2. "e the equation has been 
numerically solved for Eq. (1.3), one can always rescale units of physical quantities 
to those in the original equation by inverting relations (1.2). 

Another important example is the Wave Equation: 
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where $ = $(x, À and v is the wave velocity. In the text we absorb the velocity by 


redefining time t — vf, which leads to the equation aa = = 0 ford = $(x, t). 
This version of the equation also simplifies the construction of solutions, and the 
solution of the original equation can be recovered by rescaling the time coordinate 
back. 


This strategy is common to most examples in the book. 
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1.3 Other Methods 


The title of the book intends to waive on the type of numerical methods used to 
solve IVPs. The methods used in each problem are the very basic ones. They all 
are constructed using simple and intuitive ideas and illustrate how they can be 
implemented. The examples and codes in the text provide a basic guide to program 
more sophisticated methods. These methods belong to a particular class, based on 
the definition of a discrete domain Dg, which is a subset of the domain D of solution 
in the continuum, and then a numerical solution is constructed on Dy. This applies 
to cases involving ODEs and PDEs. 

In the case of PDEs, linear equations, including wave-like and diffusion equa- 
tions, use the vertex centered Finite Differences discretization, whereas quasi-linear 
equations, specifically related to hydrodynamical problems, use the cell-centered 
Finite Volume discretization. More sophisticated improvements are suggested at the 
end of each chapter that improve accuracy or stability of solutions; however, the 
methods in the text belong to one of these two basic classes. 

This means that we have left aside important methods also used in the solution 
of IVPs, particularly Spectral Methods. The basic idea of spectral methods consists 
in assuming that the functions involved in the DEs are expressed as a linear 
combination of orthogonal polynomials. The result is that the DEs transform into 
a set of equations for the coefficients of the expansion. Depending on the boundary 
conditions, some bases of polynomials are more used than other, for example, a 
cubic domain commonly uses the Chebyshev polynomials as the basis, whereas the 
Fourier basis is adequate for problems in a periodic domain. 

This is an elegant, useful, and accurate method to solve DEs, however is not 
as basic as the methods in this book and uses a completely different idea as to be 
somehow described alongside with the methods in this book. These methods deserve 
their own space. 


1.4 Organization of the Book 


Theory of the numerical methods used is complemented with pieces of code that 
illustrate the implementation of the methods on the fly. For this fortran 90 is 
used within the text because of its similarity of pseudocode. 

We start in Chap. 2 with the solution of IVPs related to ODEs, where elementary 
numerical methods are constructed, followed by more accurate and typically used 
methods. A variety of applications are used to illustrate the potential of solving 
ODEs has in various scenarios. Chapter 3 describes the solution if IVPs related to 
PDEs in a space-time domain with one spatial dimension that we call problems 
in 1+1 dimensions, using Finite Differences approximations and simple evolution 
methods, whereas Chap. 4 contains the solution of problems also in 1+1, this time 
using the Method of Lines. In Chap. 5 we also solve 1+1 problems this time using 
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Finite Volume discretization, suitable to solve evolution equations whose solutions 
develop discontinuities. Finally in Chap. 6 we describe the strategy to solve 2+1 and 
3+1 problems, problems in a domain with two and three spatial dimensions. 

Finally, the codes in fortran 90 and c++, usable to reproduce the results of 
the examples in the text are enclosed in appendices and supplementary material. 
Codes for exercises and challenges will remain undercover. 


Chapter 2 A 
Ordinary Differential Equations oa 


Abstract In this chapter we illustrate the implementation of the simplest numerical 
methods that help solving Initial Value Problems associated to Ordinary Differential 
Equations. The chapter starts with the description of the general problem and its 
definition on a discrete domain. It continues with the construction of basic and 
intuitive numerical methods, namely, Euler type of methods. Later on, second-order 
accurate Runge-Kutta methods are constructed. Illustration of these methods starts 
with problems involving only one equation, the Newton Cooling law, which has 
a well-behaved attractor solution, followed by the Harmonic Oscillator, written as 
a system of two coupled first-order equations, and after that we tackle problems 
of systems consisting of nonlinear coupled equations. Error estimates of numerical 
solutions, as well as convergence and self-convergence tests are essential to our 
approach, and their implementation is described in detail. In the final section, we 
present a number of applications that range from purely dynamical systems to 
problems of celestial mechanics. 


Keywords Ordinary differential equations - Basic methods - Error theory - 
Convergence 


In this chapter we illustrate the implementation of the simplest numerical meth- 
ods that help solving Initial Value Problems associated to Ordinary Differential 
Equations. The chapter starts with the description of the general problem and its 
definition on a discrete domain. It continues with the construction of basic and 
intuitive numerical methods, namely, Euler type of methods. Later on, second-order 
accurate Runge-Kutta methods are constructed. Illustration of these methods starts 
with problems involving only one equation, the Newton Cooling law, which has 
a well-behaved attractor solution, followed by the Harmonic Oscillator, written as 
a system of two coupled first-order equations, and after that we tackle problems 
of systems consisting of nonlinear coupled equations. Error estimates of numerical 
solutions, as well as convergence and self-convergence tests are essential to our 
approach, and their implementation is described in detail. In the final section, we 
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present a number of applications that range from purely dynamical systems to 
problems of celestial mechanics. 


2. The General Problem 


Consider the generic Initial Value Problem associated to an Ordinary Differential 
Equation defined by 


du _ = 24 
T= fu) uu) (2.1) 
D = (0, ty] Domain 


u(t = 0) = ug Initial Condition 


where f is an arbitrary function of the independent variable ¢ and the unknown 
function u. 

In this chapter we describe the method to construct numerical solutions of this 
type of problem in a discrete domain. The method has two basic steps: 


A. Construct a discrete version Dg of the domain D. 
B. Construct the numerical solution on Dg. 


Step A. In all the examples of this chapter, as well as for the description 
of theoretical concepts, we use a numerical domain D; uniformly discretized as 
follows. For a given positive integer N, one defines Dg C D, as the set of points 
t; € D, such that t; = i At, with i = 0, ..., N, where At = ty /N is the numerical 
resolution. That is, D4 is a set of N + 1 real numbers that separate N cells of size 
At. Consider keeping in mind the difference between the number of points of Dg 
and the number of cells implicitly defined. 

The numerical solution of the problem (2.1) is the set of values u; = u(t;) that 
at each point of Dg satisfies the equation approximately. 

Step B. Construct the solution using different numerical methods, with different 
accuracy and other properties discussed later on, like convergence rate and stability. 

We start by describing the basics of the simplest methods before constructing 
the most elaborate ones. For that we need a workhorse Initial Value Problem (IVP) 
associated to an Ordinary Differential Equation (ODE) like (2.1). 


2.2 Workhorse Example 1: Newton Cooling Law 


There is a workhorse example with an equation that is used to illustrate the 
numerical solution of IVPs, the Newton Cooling Law. This law models the time 
dependence of temperature of a substance in a thermal bath, for example, the 
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temperature of the coffee in a cup which is in contact with the air at room 
temperature. The expression of this law is 


ST utu T) (2.2) 
ge | 


where T is the substance temperature, 7; the ambient temperature, and x is the 
cooling or heating rate of the substance in the room. This equation can be solved in 
a closed form by separation of variables as follows: 


dT 
TT 
nT- Ta) 244A > 


Tg e «^A 


—kdt => 


, 


with A a constant of integration. Now, assuming the initial temperature of the 
substance is T(t = 0) = Tọ, the solution reads 


T = Ta + (To — Te *. (2.3) 


This solution converges exponentially in time to an asymptotic value which 
coincides with the room temperature. This attractor behavior of the solution is a 
friendly property that helps to illustrate how intuitive and simple numerical methods 
work. Examples of the solution (2.3) are shown in Fig. 2.1 for two different initial 
temperatures To, ambient temperature Ta = 25C and x = 0.1 sai 


Fig. 2.1 Exact solution of 40 
Newton Cooling Law for two 

different initial temperatures a5. 
To — 15, 40 degrees, say 
Celsius (C), ambient 
temperature Tọ = 25C 
degrees, and constant 

K = 0.1s7!. Notice the 25. Me 
temperature for the two a 
solutions converges 20 | 
exponentially in time toward 
the value T = Ta 


30 + 


T (C) 


15 t 
0 


20 40 60 80 100 
t (s) 
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2.3 Euler Method 


The simplest and more intuitive method is Euler method. This method is based on 
the definition of derivative from Calculus. Consider a zoom of the discrete domain 
near t; € Dg as shown in Fig. 2.2, and assume Af is small. Then an approximate 
value of the derivative of the function u at fj..; can be estimated as 


du uj —uj-] — uj — ui] 
ES E 


dt |. s ^ dj—tj At 


(2.4) 


Notice that it is only an approximation since we have omitted the limit when At — 
0 from the definition of derivative. Let us now assume we know the value of the 
solution u;-, at point ti—1, and then it is possible to evaluate any function f at 
(tj 1, uj-1). Using the above expression in the original definition of the general 
IVP (2.1), one has the approximation: 


uj — Ui—1 


Aro f (ti-1, uj). 


This is a discrete version of the equation of the IVP (2.1), and uj is a solution of 
the problem at t; in terms of fj 1, uj 1 given by 


uj C uj-1  f(ti-1, ui-1) At. (2.5) 


This expression can also be constructed considering the equation of a line that passes 
through the point (t;—1, uj 1) with slope f (ti—1, uj 1), in agreement with Fig. 2.2. 

As simple as it is, this formula allows the construction of the numerical solution 
of a problem like (2.1), provided an initial condition, that in the discrete domain Dg 
would correspond to u(to) = uo. Specifically, in the discrete domain, knowing uo 


Fig. 2.2 Region near f; 
showing the concept of 
approximate derivative. The 
thick curve represents a 
function defined in the 
continuum, whereas the 
straight line represents the 
tangent line to the curve u(t) 
at ti—1. This plot indicates the 
line only as an approximation 
to the exact curve. The white 
point indicates the 
approximate numerical 
solution u; at ti 
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one can use (2.5) to construct u; = u(t). With this value use (2.5) again to construct 
u2 = u(t2) and so forth until uy = u(ty). The whole set of values uo, ..., uy is a 
numerical solution of the problem in Dg. 

More formally, expression (2.5) can be seen as a Taylor series expansion around 
tj 1, which explicitly would read 


+ O(t’) 


ti-1 


du 
uj = ui—1 + (ti — ti-1) — 


+ OCA) 


+ a~” 
"HE uid 
i-1 E? 


ti—1 


uj—1 fii ui-1)At + OCAD). 


The difference between this expression and (2.5) is that in the later, we have an 
estimate of the error. The error term O(A??) is the difference between the exact 
solution at f; and the numerical solution u;. Notice that in the expansion above, one 
assumes uj, to be the exact solution at t;—1, because the black dot belongs to the 
curve in Fig. 2.2. This is the reason why this error is called the local error of the 
numerical solution. 

One can estimate the error of the method starting from the initial condition at fo 
which is an exact value, until ty, the local error of each step accumulates N times 
and adds to the global error of the numerical solution. 

By applying (2.5) successively from uo to u1, from u; to u2, and so on, until 
uy, the accumulated error is proportional to N O(Ar?), and since by definition 
At = (ty — to)/ N, that is N = (ty — to)/At, the accumulated error is of order 
O(At). Therefore the global error of the numerical solution constructed with this 
method is of order one, or of order O(Art). 

By this argument, in general a method that has a local error of order O(A!") 
will have a global error of order O(A/"- 1). 

What is the meaning of the error order? Let us perform a simple analysis for Euler 
method. Euler method has a global error of order O(At), which means that as we 
increase the resolution of the numerical domain, namely, increase N or equivalently 
decrease Af, the numerical solution on Dg should approach the exact solution, the 
solution in the continuous domain D. 

Let us work out an example. Assume we know the exact solution u^ of an IVP 
like that in (2.1) and calculate two numerical solutions u : and u? with Euler method, 
using resolutions At and At/2, respectively. We want to compare the accuracy of 
both numerical solutions. Knowing the global error is of order O(At), the numerical 
solution at each point of the domain can be written as 


| — uf + E(tj) At, 


At 
uj = aj + EH, 


= 
ll 
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where E(t;) is the error accumulated from tọ until t;. Notice that this comparison 
requires the solution in the continuous domain D only at points ti € Dg, where 
the continuous and discrete domains coincide. From these relations one defines the 
convergence factor of the numerical solutions by 


(2.6) 


The Convergence Factor (CF) provides a criterion to decide when a numerical 
solution converges toward the solution in the continuum. In order to use this concept 
in practice, let us calculate numerical solutions of the Newton Cooling Law. 


Numerical Solution of Newton Cooling Law. In order to construct the numerical 
solution, we identify from the theory above the independent variable with time t — 
t and the solution function with Temperature u — T. In these terms, the discrete 
domain Dg will be given by t; = i At fori = 0, ..., N, whereas the temperature will 
have values T; = T (t;). 

Then, using formula (2.5) applied to Eq. (2.2) from time f;.., to f; gives 


dT 
dp Tiat At 


fii 


= T-1 t «(Tq — Ti -1)At. (2.7) 


Notice that er = k (Ta — T) in (2.2) has an important property, namely, it does not 
depend explicitly on the independent variable t, which makes easy the calculation of 
the time derivative of temperature. This property makes the equation autonomous. 
Let us now use this formula to construct the solution for parameters 7; — 20C, 
k = 0.387! and the initial temperature of the substance Ty = 80C. It is necessary 
to define the discrete domain, for which we assume tf = 25s and N = 50, which 
implies the resolution is At = t¢/N = 0.5s. 
Let us calculate the temperature for the first few values of the discrete time with 
a calculator 
dT 
Ti = To + —| At (2.8) 
dt |, 


= To + k(Ta — To) At 
= 80 + 0.3(20 — 80)0.5 
= 71 


At 


T; n+% 
Sh P 
dt |, 


= Tı + k(Ta — Ti) At 
= 71 + 0.3(20 — 71)0.5 
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— 63.35 
T; = 56.8475 
T4 — 51.32037 


To9 = 22.32557 
T39 = 20.4578 
Tso = 20.0177. 


This solution indicates that at t9 = 50 At = 25s, the temperature of the substance 
is nearly the room temperature T, = 20C. The comparison with the exact solution 
is shown in Fig. 2.3. 

The global error of the numerical solution at each point of the discrete domain 
depends of the resolution and is written as e(At) = T; — T where TÀ is the 
exact solution (2.3) evaluated at time t; € Dg. Now, in order to investigate whether 
the error of Euler method behaves as predicted by Eq. (2.6), one needs to calculate 
the numerical solution with higher resolution by increasing N or equivalently 
decreasing At. We then calculate the numerical solution using resolutions At) = 
0.5s, At; = At1/2, Ats = At /2, and At4 = At3/2, which is equivalent to define 
the discrete domain Dg with N = 50, 100, 200,, and 400 cells, respectively. The 
error for each of these solutions is shown in Fig. 2.3. 

The fact that the error using resolution Af, is twice as big as that using Af? 
indicates that the criterion of convergence in (2.6) is fulfilled. Notice that in general, 
the error of the solution calculated with resolution Af; is twice as big as the error 
using resolution Atk+1ı for k = 1,2, 3, which proofs the error converges to zero 
according to the theory in (2.6). When this is the case, it can be said that the 
numerical solution converges to the exact solution with a rate consistent with the 
error of the numerical method, in this case the global error of Euler method. 


: . Exact —— 
Numerical using ^t,-0.5 c 


e(At) 


Roe 
Aty20.0625 --&+- 


t (s) t (s) 


Fig. 2.3 Numerical solution using Euler method. (Left) Comparison of the numerical solution 
using Af = 0.5 and the exact solution. (Right) Error using four different resolutions. The physical 
parameters in these solutions are 7; = 20C, To = 80C and x = 0.3 s7! 
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These results were constructed using the fortran 90 code shown below, which is 
the very basic code we start with. The instructions include declaration of variables 
and arrays, allocation of memory for the arrays, discretization of the numerical 
domain, setting of initial conditions, and a loop that constructs the numerical 
solution at each point of the numerical domain and data output. In summary, it 
contains all the elements needed in the codes for the rest of the book. It is convenient 
to know that we declare the elements of the numerical domain t; € Dg and the 
numerical solution 7; as entries of arrays of double precision numbers, which helps 
illustrating the concepts of error an convergence, and later on this approach will be 
relaxed for ease of programming and memory saving: 


program NewtCoolLaw Euler 


implicit none 


real(kind-8) t0,tmax,dt,Temp0,kappa,Ta 
real(kind-8), allocatable, dimension (:) :: t,Temp,Texact,error 
integer i,N,resolution label 


! We define Dd and physical parameters 

resolution label - 1 

N = 50 ! Number of cells of Dd 

tO = 0.0 ! Initial time 

tmax = 25.0 ! Final time 

N = 2x«(resolution label-1) + N ! Number of cells for the 
discretized domain 


kappa = 0.3 ! Cooling rate constant 
Ta = 20.0 ! Room temperature 
TempO = 80.0 ! Initial temperature of the substance 


! Allocate memory for the various arrays 
! t: time 


! Temp: Temperature 


! Texact: Exact solution 
! error: Temperature - exact solution 
allocate(t(0:N),Temp(0:N) , Texact (0:N) , ezror (0:N)) 


| ---» PART A «--- 


! Definition of the Discrete domain 


dt = (tmax - t0) / dble(N) 
do i=0,N 

t(i) = tO + dt * dble(i) 
end do 


print «, 'dt-',dt ! This will tell you whether dt is correct on 
the screen 
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| ---> PART B «--- 


! Euler method 


Temp(0) = TempO 


do i=1,N 
Temp (i) = Temp(i-1) + dt « kappa » (Ta - Temp(i-1)) 
end do 


! ---» Ends Part B «--- 

! Calculation of the exact solution and error 
Texact = Ta + (Temp0-Ta)xexp(-kappaxt) 

error - Temp - Texact 


! Saving data to a file 
open(1,file-'NLdata.dat') 
do i=0,N,2«* (resolution _label-1) ! Includes the dawnsampling 
of the output 
write(1,*) t(i),Temp(i),Texact (i) ,error (i) 
end do 


close (1) 
end program 


This example shows that Euler method is useful and produces solutions that 
converge for this particular IVP whose solution is smooth with asymptotic constant 
value. 


How to Check Convergence Using the Code. The program above is written conve- 
niently for checking convergence. In order to understand how it works, consider that 
one calculates the numerical solution u ; on the numerical domain D H containing 
N + 1 points and resolution Atı. Then a second solution u? 
domain D3 consisting of 2N + 1 points and resolution At? = Atı/2 and so on 
by doubling resolution. The solutions u T E uj. ... can be compared only at the 
points of D 1 which is completely contained in DŽ, which in turn is contained in D3 
and so on. 

The parameter resolution label is an integer that sets the number of 


points of the numerical domain ea to gresolution_label-1 Nr + 1, Now, 


the numerical solutions calculated on Dl, D2, D3 ,.. can be compared. By 


is constructed on the 


construction all the elements of D* are contained in the numerical domain pst 


and therefore D i is contained in all the subsequent numerical domains. 

The parameter resolution label also is used to downsample the output in 
such a way that the solution is only recorded at the points of D}, where ul, ur, ie is 
can be compared. With this method it is easy to plot the numerical solutions 
calculated on D}, D2, D3, ... and their associated errors at exactly the points of 


D} as done in Fig. 2.3. 
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About the Implementation. There is an alternative in the implementation of Euler 
and the rest of methods described later on, which does not need the use of arrays 
to allocate the values of the discrete time and temperature; instead it calculates and 
saves the numerical solution on the fly. This version of the program appears next: 


program NewtCoolLaw Euler NoArrays 


implicit none 


real(kind-8) t0,tmax,t,dt,TempO,Temp,Temp p,Texact,error,kappa,Ta 
integer i,N,resolution label 


! We define some parameter values 


resolution label - 4 

tO = 0.0 ! Initial time 

tmax = 25.0 ! Final time 

N = 50 ! Base number of cells 

N = 2x«(resolution label-1) +» N ! Effective number of cells for 
the dicretized domain 

kappa - 0.3 ! Cooling rate constant 

Ta = 20.0 ! Room temperature 

TempO - 80.0 ! Initial temperature of the substance 


! Other variables 

| t: time 

! Temp: Temperature at time n+1 

! Temp p: Temperature at time n 

! Texact: Exact solution 

! error: Temperature - exact solution 


|] ---» PART A «--- 

! Discretization fo domain 

dt = (tmax - t0) / dble(N) 

print «, 'dt-',dt ! This will tell you whether dt is what you 
expect 


open(1,file-'NLdata.dat') 


! Set initial conditions and initial diagnostics 
Eo = C0 

Temp = Tempo 

Texact = Tempo 

error = Temp - Texact 


! Save initial data 
write(1,*) '# Time T Texact error’ 
write(1,*) t,Temp, Texact,error 


| ---> PART B «--- 
do i=1,N 
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t= E + dt 


! Evolution according to Euler method 
Temp p = Temp 
Temp = Temp p + dt « kappa « (Ta - Temp p) 


! Calculation of the exact solution and error 
Texact = Ta + (TempO0-Ta)xexp(-kappaxst) 
error - Temp - Texact 


! Saving data to a file 
if (mod(i,2«** (resolution_label-1)).eq.0) write(1,*) t,Temp, 
Texact,error 


end do 


close (1) 


end program 


The Style in This Chapter. We will use the first style, the one that stores domain 
and solutions in arrays, for the illustration of the methods and applications in the 
reminder of the chapter. The code above shows that it is not difficult to convert one 
style into the other one, and so it is for all methods and examples below. 


2.4 Backward Euler Method 


Recall that Euler method constructs the solution u; at t; using the equation of a 
line with slope f(t;-1, uj 1), evaluated at the point ¢;_;. In the Backward Euler 
method, there is a slight variant. The idea is the same, it uses the equation of a line; 
however, the slope of this line is f (t;, u;), evaluated at point t;. The expression for 
the construction of the solution is as follows: 


uj C uj-y + f (ti, uj) At. (2.9) 


In order to implement this method, one needs to first estimate u; using Euler method 
and then evaluate f (tj, ui), as illustrated with steps 1—3 in Fig. 2.4. The construction 
of the solution at each ft; can be implemented by substituting the part B of the 
previous code with the following chunk of code 


| 2. PART B €--- 
Temp(0) = Tempo 
do i=1,N 


do j=1,2 
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Fig. 2.4 Region near f; 
showing the concept of 
approximate derivative 
according to (2.9). Number 1 
indicates a step using Euler 
method, number 2 indicates 
that the derivative has to be 
evaluated there f (t;, u;), and 
number 3 indicates this slope 
is used to construct a line 
passing through (f;—1, uj—1) 
with slope f(t;, u;). The 
white point indicates the 
numerical solution 
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Fig. 2.5 Numerical solution using the Backward Euler method. (Left) Comparison of the numer- 
ical solution using At — 0.5 and the exact solution. (Right) Error using four different resolutions 


if (j.eq.1) then 
Temp (i) = Temp(i-1) + dt « kappa x» (Ta - Temp(i-1)) 
else 
Temp (i) = Temp(i-1) + dt * kappa x» (Ta - Temp(i)) 
end if 
end do 
end do 


Numerical Solution. In order to compare with Euler method, we solve the Newton 
Cooling Law with the same parameters as before. The results of the numerical 
solution and the error e(At) = T; — T7, where T is the exact solution (2.3) appears 
in Fig. 2.5 for various resolutions. 

Notice that the error using the Backward Euler method has the opposite sign to 
that when using Euler method. The method also converges with order one, since 
e(t) — 2 e(Ati L1), k = 1, 2, 3. Finally, observe that the error of both methods is 
of similar magnitude, which will be exploited by the following method. 
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Based on these two simple methods, it is possible to construct a more accurate one. 
From the example above, we know the error using Euler method has the opposite 
sign of that using the Backward Euler method, as can be seen from Figs. 2.3 and 2.5. 

Euler method is based on the idea of using the line equation with the slope 
evaluated at t;_1, whereas the Backward Euler method uses the line equation with 
slope evaluated at t;. One of them underestimates the slope with respect to the 
exact solution, and the other one overestimates the slope. This can be seen for 
the monotonically growing functions in Figs. 2.2 and 2.4, where the approximate 
solution is indicated with the white point. The idea now is to use a line equation 
with a slope that is the average of the slopes at ti—ı and ti. 

We denote the slopes at t;—1 and t; by kı and k2, respectively, and the method is 
written as 


1 
uj = uj, + 5 + ky)At, (2.10) 
ki = f(ti-1, ui-1). 
k2 = f (ti, ui). 


In the case of the Newton Cooling Law, kj = «(Tq — T;-1) and ko = «(Ta — 
T;). Likewise in the Backward Euler method, this can be programmed using two 
steps in the part B of the code. It would suffice to replace the code in Part B with 
the following chunk of code, which will need declaring the new double precision 
numbers k1 and k2: 


|! ---> PART B «--- 
Temp(0) = TempO 
do i-1,N 
do: 121,2 
if (j.eq.1) then 
kl = kappa « ( Ta - Temp(i-1) ) 
Temp (i) = Temp(i-1) + dt * kl 
else 
k2 = kappa « ( Ta - Temp(i) ) 
end if 
Temp (i) = Temp(i-1) + 0.5d0 x ( k1 + k2 ) x dt 
end do 
end do 


The numerical solution and error are shown in Fig. 2.6. Important information 
immediately arises; the error is one order of magnitude smaller using resolution Ar 
compared to that using Euler and Backward Euler methods, and the error decreases 
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Exact ——1 
Numerical using ^t,-0.5 -5 


error(At) 
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Fig. 2.6 Numerical solution using the Average Euler method. (Left) Comparison of the numerical 
solution using At = 0.5 and the exact solution. (Right) Error using various resolutions 


faster to zero with resolution. Specifically, e(Atj) ^ 4 e(At2?) which means that the 
numerical error approaches zero twice as faster than the prediction of formula (2.6). 

We will later formalize the accuracy of this method, since it is a particular case 
of the second-order accurate Runge-Kutta class of solvers seen later in Sect. 2.8. By 
now it is important to notice that this method is more accurate than the previous two 
ones and converges faster. 


2.6 Workhorse Example 2: Harmonic Oscillator 


For a spring obeying Hooke law subject to a damping force, Second Newton Law 
establishes the equation of motion for a damped harmonic oscillator: 


mx = —kx —bx, or equivalently 
k 
X¥+—x+—x=0, (2.11) 
m m 


where m is the mass of the oscillator and k is the spring’s constant, the term bx 
corresponds to a damping term modeled with a linear function of velocity. This 
equation has unique solution provided initial conditions for x(0) = xo and x(0) = 
vo. 

In the examples below, we assume the initial conditions x(0) = 1 and x (0) = 0, 
that is, the spring is pulled to the right from the equilibrium position and will be 
released at initial time. 

Case I, the simple harmonic oscillator. In this case b = 0, and for the initial 
conditions, the exact solution and its time derivative are 


1. Dt 
x(t) = 3 + so = cos(ot), (2.12) 


x(t) = —osin(ot), 
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Fig. 2.7 (Left) Phase space diagram of the simple harmonic oscillator (b = 0), with m = 1/2, 
k = 2 and initial conditions x(0) = 1 and x(0) = 0. The cross indicates the point of the initial 
conditions. (Right) Energy function (2.13) for the same parameters. Isocontours of E illustrate the 
trajectories of the system on the phase space for different values of energy, which can be changed 
at initial time using different initial conditions x(0) and x(0). The ellipse on the left corresponds 


PEE TT: ip 2 
to the initial energy E — x + Tz le=1,y=0) =1 


where w = ,/k/m. In order to have a numerically well-defined example, we set the 
mass and spring parameters to m = 1/2 and k = 2, so that w = 2. An illustrative 
portrait of the system's behavior is the phase space diagram. Such diagram is defined 
by the position and velocity in the xx—plane. For the particular values of the 
parameters used and the initial conditions, all the points of the phase space diagram 
are (x(t), x(f)) = (cos(2t), —2sin(2t)) that correspond to the parametric form of 
the ellipse in Fig. 2.7, where the cross indicates the position of the system at initial 
time. 

Each point in this diagram corresponds to a state of the system. The system starts 
in the position (1, 0), and the trajectory moves downward with negative velocity 
and x(t) starts decreasing. Turning points are those of maximum extension x = 1 
and maximum compression x — —1 where the velocity is zero x — 0. When the 
oscillator passes through the equilibrium position at x = 0, the velocity is maximum 
x = 2 when moving to the right at point (0, 2) and minimum x = —2 when moving 
to the left at point (0, —2). 

In this particular case of b = 0, the system is conservative, with total energy: 


E=T+U : elu 
= = -mx —kx 
2 2 


I 9 2 
= j^ +x 
y x? 
EE 4 T (2.13) 
For a constant value of E, there is a relation between x and x that defines an ellipse 
in the xx —plane, with horizontal semi-axis VE and vertical semi-axis 2V E , Which 
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is exactly as it appears in Fig. 2.7. Other initial conditions can define a different 
value of E at initial time and the states of the system would belong to a different 
ellipse. Isocontours of the energy E in (2.13) define different ellipses as illustrated 
in the right panel of Fig. 2.7. 

Case II, the damped harmonic oscillator. In this case b ZZ 0, for the initial 
conditions x(0) — 1 and x(0) — 0, the exact solution reads 


x(t) 2 et E sin(a@Bt) + costar) => 


x(t) = —ae™ E sin(wt) + sosta) 
+ re^ [cos(wBt) — B sin(aBrt)], (2.14) 


where a = 2 and B = y |1 — 4km/P? |. In order to illustrate the solution, we again 
use the parameters m = 1/2, k = 2 and b = 0.1, and the trajectory given by points 
(x(t), x (t)) using (2.14) is shown in Fig. 2.8. 

In this case with b > 0, the states of the system follow an inward spiral toward 
the origin of the phase space. This means the energy is being dissipated with rate: 


dE d (1 1 
= mx? + —kx? 
dt dt \2 2 


= (mx + kx)x 
= —bi?, 
which depends on the value of b. 
1 
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Fig. 2.8 Solution of the damped harmonic oscillator with b = 0.1. (Left) Position as function of 
time. (Right) Trajectory in phase space, which shows an inward espiral toward the origin, starting 
from the point (1, 0). These plots indicate an attractor behavior toward the equilibrium position of 
the system. For comparison we draw the trajectory with b = 0 
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Numerical Solution 

The harmonic oscillator equation is second-order, whereas the methods described 
work for first-order equations. The methods can still be used because it is possible 
to write a second-order equation of motion as a set of two first-order equations. 
This is easily done by defining y — x, then the IVP associated to Eq. (2.11) can be 
rewritten as 


x=y 
b k (2.15) 


j=-2y- “x 
m m 


with initial conditions x(0) = xo and y(0) = yo, to be solved in the domain 1 € 
[0, t¢]. Notice that f is the independent variable and the unknowns are x and y. 

In this case one needs to solve for both x; and y; in the numerical discrete domain 
Da whose elements are t;, i = 0, ..., ty. One important difference between this 
problem and the Newton Cooling Law is that now each unknown x and y has its 
own slope da = y, and dy = —2y— 5y. 


Euler Method. We first construct the solution using Euler method, which for the 
system (2.15) reads 


4 dx 3 
Xi = Xi— — 
i i—l dt = 
= xj-1 + yi-1 At, 
dy 
=y t At 
Yi yi-1 + dt 
b k 
= yi-1 + {| ——yi-1 = —xi-1] At. (2.16) 
m m 


As an example, we define the following numerical parameters, tf = 5, N = 
200 or equivalently At; = 0.025, and in order to check the convergence, we also 
define and use resolutions At? = A11/2, Atz = Ato/2, At4 = Ata/2. The code 
oas E.f90 that calculates the numerical solution is the following: 


program oas E 
implicit none 


real(kind-8) t0,tmax,dt,x0,y0,omega,k,m 

real(kind-8), allocatable, dimension (:) :: t,x,y,x ex,y ex, 
err x,err y 

integer i,N,j,resolution label 


resolution label - 1 
N = 200 
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t0 = 0.0 

tmax - 5.0 

N = 2x«(resolution label-1) + N ! Number of cells for the 
dicretized domain 


x02 L2 
yO = 0.0 
k = 2.0 
m= 0.5 


omega = sqrt (k/m) 


! Meaning of different variables 


|! t: time 
l aces X 
! y: y 


! x ex: Exact x 
! y ex: Exact y 
! err x: X - x ex 
err y: y - y ex 


! Allocate memory for the various arrays 
allocate(t(0:N),x(0:N) , y (0:N) , x ex(0:N),y ex(0:N),err x(0:N), 
err y(0:N)) 


| ---> PART A «--- 


dt = (tmax - t0) / dble(N) 
do i=0,N 
t(i) = tO + dt * dble(i) 
end do 
| <--> PART B «--- 
x(0) = x0 
y(0) = y0 
do i=1,N 
x(i) = x(i-1) + dt æ y(i-1) 
y(i) = y(i-1) + dt * ( -omegax*2 x x(i-1) ) 
end do ! ---> Ends Part B <--- 


! Exact solution 

X ex = x0 * cos (omegaxt) 

y ex = - x0 « omega » sin(omegaxt) 
err X =X - x ex 

erry-y- yex 


! Saving data to a file 
open(1,file-'HO E.dat') 
do i=0,N,2«** (resolution _label-1) 
write(1,x) t(i),x(i),y(i),x ex(i),y ex(i),err x(i),err y(i) 
end do 
close (1) 


end program 
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Fig. 2.9 From left to right, we show the phase space diagram of the numerical solution using 
resolution At; = 0.025, the numerical solution for the amplitude of the oscillator also using 
resolution Af, and the error of the numerical solution using various resolutions. From top to 
bottom, the results are for Euler, Backward Euler, and Average Euler methods. The time domain 
uses ty = 5 


The results are shown in the first row of Fig. 2.9. At the left we show the phase 
space diagram of the numerical solution using Euler method. Notice that both the 
amplitude and velocity of the oscillator grow in time, whereas the exact solution 
defines an ellipse. The growth of amplitude can be seen in the comparison between 
the numerical solution and the exact solution for x(t) in the middle panel. At the 
right we show the error of the numerical solution using various resolutions for the 
amplitude x; at time t; defined as 

ex(Aty) = xi — xj 


L1 


(2.17) 


which is the difference between the exact solution x° in (2.12) evaluated at time t; 
and the numerical solution x; also at time t;. This plot shows that the error converges 
to zero with fist order, consistently with Eq. (2.6) since ex (Ath) ^ 2e,(Atg+1) for 
k = 1,2,3. 


Backward Euler Method. In this case one needs to calculate the derivatives dx/dt 
and dy /dt at time t;. Like in the Newton Cooling Law this is done in two steps: 
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Advance from fj, to t; according to Euler method: 
Xj = xi-1 t yi-1At, 
b k 
yi = yi-1 + | ——yi-1 — —xi-1 } At. 
m m 


With these values calculate exl — yj and wy | = E yi E xj. Then the solution 


: 7 m 
at time f; 1S 


Xi = xi-1 + yi At, 


b k 
yi = yi-it | ——yi — —xi | At. 
m m 


In order to code this method, one only needs to substitute part B of the previous 
code with the following: 


| ---> PART B «--- 


x(0) = x0 
y(0) = y0 
do i=1,N 
do j=1,2 
if (j.eq.1) then 
x(i) = x(i-1) + dt x y(i-1) 
y(i) = y(i-1) + dt * ( -omegax«2 x x(i-1) ) 
else 
x(i) = x(i-1) + dt x y(i) 
y(i) = y(i-1) + dt x ( -omegax«2 x x(i) ) 
end if 
end do 
end do 


For comparison we use the same numerical parameters as for the Euler method, 
tf = 5, N = 100 or equivalently At; = 0.025, and for convergence checks we 
also use resolutions At? = At) /2, Ats = At2/2, At4 = At3/2. The results are 
shown in the second row of Fig. 2.9. In this case the phase space solution shows an 
inspiral toward the origin, which is the behavior of the damped oscillator. This can 
also be observed in the amplitude of x(t), which decreases with respect to the exact 
amplitude. 

Even though the numerical solution is different from that calculated using Euler 
method, it also converges with first order according to the mid-right plot of Fig. 2.9, 
which satisfies the theory in (2.6). 

Due to the fact that the results are similar to those of a damped harmonic 
oscillator, the effect produced by the Backward Euler method is called dissipation, 
numerical dissipation. 


2.6 Workhorse Example 2: Harmonic Oscillator 27 


Average Euler Method. We now implement the numerical solution using the third 
of the methods seen so far. In this case of two equations, one needs to average the 
slopes dx/dt and dy/dt at times t;_ and t; following formulas (2.10). For the sake 
of clarity and ease of implementation, we will define the slopes kj, kıy as the 
derivatives of x and y at fj; and k2x, k2y at t;. The algorithm for the integration is 
the following: 


Execute an Euler step 


dx 
k = — = yi- P 
lx dt " Ji-1 
k dy b k 
= = | -—yj-1 — —xi-1 J, 
ly dt - m” 1 m 1 


Xj = xi-1 + ky, At, 
yi = yi-1- ky At. 


Then calculate the slopes k2, and kz, using these new values, and finally calculate 
the solution at t; with the average slopes 


NEN dx S 
= di , = yi. 
pD b k 
= 7 X , 
2y dt m" m 


1 

xj =Xj-1+ 5 ix + kx)At, 
1 

yi = Vi-1 + 5 x + ko) At. 


The implementation is straightforward by defining four double precision numbers 
k1x, kly, k2x, k2y, and substituting the following part B in the code: 


| ---> PART B «--- 
x(0) = x0 
y(0) = y0 
do i=1,N 
do j=1,2 
if (j.eq.1) then 
k1x - y(i-1) 


kly = -omegax«2 x x(i-1) 

x(i) = x(i-1) + kix + dt 

y(i) = y(i-1) + kly * dt 
else 

k2x - y(i) 


k2y -omegax«2 x x(i) 
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x(i) = x(i-1) + 0.5d0 « ( k1x + k2x ) + dt 
y(i) = y(i-1) + 0.580 « ( kly + k2y ) « dt 
end if 
end do 
end do 


We again construct the numerical solution using exactly the same numerical 
parameters as for the previous methods. The results are shown in the third row of 
Fig. 2.9. In this case the phase space of the numerical solutions looks much more 
similar to the ellipse of the exact solution and x(t) also maintains its amplitude 
better. Nonetheless, there are errors, which for resolution Af, are one order of 
magnitude smaller in comparison with those obtained with Euler and Backward 
Euler methods. There is also the effect of faster convergence rate, since the error of 
the numerical solution for x is such that e, (Atg) ^ 4e,(Atg41) for k = 1, 2, 3. 

In summary, using Euler method the amplitude of the numerical solution grows 
with respect to the exact solution and artificially injects energy to the system. 

Using the Backward Euler method, the amplitude of the numerical solution 
decreases with respect to the exact solution and dissipates energy, producing a 
damping effect on the amplitude of the oscillations. 

Using the Average Euler method the system produces a solution that is more 
energy conservative compared to the other two methods. 

As a final exercise, let us use the three methods to produce a solution in a bigger 
time domain, measure its amplitude and energy E — Imy? + ie = 1 y qx. 

The results are shown in Fig. 2.10 in the time domain ¢ € [0, 50], which contains 
about 16 periods of the motion, using resolution A14. Notice that even with this high 
resolution, in this big domain, Euler method injects nearly 200% of energy, and the 
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Fig. 2.10 Effects of each method on the amplitude of the numerical solution (top) and the energy 
(bottom). In all the cases, the continuous line indicates the exact value and the points indicate the 
numerical solution. From left to right, the method used are Euler, Backward Euler, and Average 
Euler. The resolution used for this example is At4 — 0.003125 
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amplitude of the motion increases nearly by a factor of 1.5. The Backward Euler 
dissipates energy until it is reduced to 50% of its initial value and the amplitude of 
the motion is reduced by nearly 20% of its initial value. Finally, the average method 
injects energy of the order of ~1074%. 

The result in this plot is very important, because it tells about the effects produced 
by the use of various methods, at least for the particular problem of a linear and 
conservative system. Imagine, for example, that one has to simulate the motion of 
a spaceship around the Sun or in its travel to Mars; the injection or dissipation 
of energy due to the method would produce very inaccurate numerical results and 
possibly wrong predictions. 

More dangerously, someone could calculate the numerical solution of the simple 
harmonic oscillator using the Backward Euler method and supply only the time 
series in the top-middle of Fig. 2.10 for its interpretation and modeling. One would 
feel tempted to believe that the time series corresponds to a damped oscillator, 
instead of the simple oscillator using a considerably dissipative numerical method. 


Exercise. It would be interesting to estimate the value of b that the three 
methods introduce in the solution of the simple harmonic oscillator. This can 
be done by fitting the data in the first row of plots of Fig. 2.10 using the exact 
solution (2.14) with b as the fitting parameter. 


2.7 Error Theory, Convergence, and Self-Convergence 


We have constructed various numerical solutions and used the concept of the 
convergence of a numerical solution to the solution in the continuum as the 
resolution is increased. It is time to formalize these ideas. 


Convergence. Letus assume we construct the numerical solution of Eq. (2.1) using 
a method with global error of order n. We do this for two resolutions At, and 
Ato = At, /2 with numerical solutions u and u? for all i = 0, ..., N. If the exact 
solution of the equation is uf, then at every t; of the numerical domain D E the 
following relations hold 


= 
ll 


l — uf + E(t) At", 


2 e At n 
up = uf + EGO). (2.18) 


that is, the numerical solution is expressed as the exact solution plus an error 
term, which is proportional to At”. Comparing the two expressions, one finds the 
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convergence factor: 


(2.19) 


If this relation holds, approximately because we dropped terms higher than O( At”) 
in Eq. (2.18), it is said that the numerical solution converges with order 7 to the 
exact solution in the continuum, or that the error converges to zero with order n. 
The number 2" is called convergence factor. 

In practice, when convergence is confirmed, it is commonly said that resolutions 
Ax; and Ax» are appropriate for convergence. This implicitly indicates that the 
solutions may not converge for arbitrary resolutions. When the numerical solutions 
converge, it is said that resolutions belong to the convergence regime. 

With these concepts we can state on solid bases that the solution of the Newton 
Cooling Law using the methods of Euler and Backward Euler converges to the exact 
solution with first order. The explanation is that the error for solutions obtained with 
successive resolutions shown in Figs. 2.3 and 2.5 show a convergence factor 2! — 2, 
which is consistent with the expression (2.6) and (2.19) for n — 1. 

In the same manner, Fig. 2.6 shows that the solution of the Newton Cooling Law 
solved with the Average Euler method converges with second order to the exact 
solution, since the error between successive resolutions shows a convergence factor 
27, which corresponds to n = 2 in Eq. (2.19). 

The solutions for the harmonic oscillator equations solved with Euler and 
Backward Euler methods, according to Fig. 2.9, show a convergence factor —2 and 
thus convergence of order one. The solution constructed using the Average Euler 
method has convergence factor 72? and therefore converges with second order to 
the exact solution. 


Self-convergence. The motivation to construct numerical solutions of Differential 
Equations is that we want to solve equations whose exact solution is unknown. 
In that case the convergence criterion above would be useless. Nevertheless, 
convergence tests and the solution of problems whose solution is known are very 
useful and allow one to understand the strength of the various methods. 

Even if the exact solution is unknown, the same idea of the convergence can be 
generalized as follows. Assume that a third numerical solution u? is constructed 
with resolution At3 = At2/2 = At;/4. Such numerical solution can be written as 


3 " At n 
u) = uf E| T) (2.20) 


2.8 Runge-Kutta Methods 31 


Combining (2.18) and (2.20), one obtains the self-convergence factor 


1 2 
| Uj iu TAD 
SCE = ad (y - GT 
I : , s (2.21) 
x 1 2n = 2” 
se 
Qn 4n 


When the solutions constructed using three successive resolutions related by a factor 
2 obey the relation (2.21), it is said the the numerical solution self-converges with 
order 7 to the solution in the continuum. 

This is a criterion used to verify that a numerical solution converges without the 
need of the exact solution. 


Exercise. Determine whether the numerical solution for x in the top row of 
Fig. 2.10 self-converges using one of the three methods. For this, calculate 
the solutions using resolutions Af, Af5, At4, and verify whether the 
approximate relation (2.21) is satisfied. 


2.8 Runge-Kutta Methods 


So far, for the generic IVP (2.1) on the discrete numerical domain Dg, we have 
constructed useful methods, specifically Euler, Backward Euler, and an Average 
Euler, that provide an expression for u; in terms of known information, namely, the 
slope of the solution at t;_; in the case of the Euler method, at t; in the case of the 
Backward Euler method and the average of these two slopes in the Average Euler 
method. The slope is used to predict the solution from t;_; to f; using the equation 
of a line. 

The Runge-Kutta (RK) method is a generalization of this strategy and consists in 
proposing a more general expression for the slope of a line such that the prediction 
of the numerical solution u; is of the type 


uj = Uj-1 + g(tj-1, ui-1, At) At, (2.22) 


where g is the slope of a line that we use to predict the value u;. The RK method 
consists in assuming g to be a linear combination of slopes 


g =ayky + azk2 +... + amkm, (2.23) 
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where k; represents the slope of the numerical solution evaluated at a given point 
within the interval [t;—1, t;] and specifically defined as 


kı = f(ti-1, ui-1). (2.24) 
k2 = f(ti-1-- b3At, uji-1 + cii At), 
k3 = f(ti-14- bo At, ui—1 + c21k At + ca2k2 At), 


km = f (ti-1-F bm-1 At, uj + Cm—1,1k1 At + Cm—1,2k2 At + ... 


+€m—1,m—1km—1 At). 


Notice that the slope at t;—1, namely, kı, is that of Euler method, whereas k2, k3, ... 
depend on the previous slopes. Coefficients b; determine the location where the 
slope is to be evaluated, and cjg are coefficients of a linear combination of all the 
slopes calculated previously. These constants are to be determined in terms of the 
accuracy of the method. 


Second-Order Runge-Kutta (RK2) 
Following [1], let us now illustrate the construction of the method in Eqs. (2.22), 
(2.23), and (2.24) for a second-order accurate solver. In this case Eq. (2.22) reduces 
to an expression with two slopes: 
uj = ui—1 + (akı + aok2)At, (2.25) 
ky = f(ti-1, ui-1), 
k2 = f(ti-1- bYAt, uji-1 + c11k1 At). 
In order to determine the constants a1, a2, b1, c11, the expression for u; in (2.25) is 
compared with a Taylor expansion to second order of u around t;_; as follows: 
ky = fGi-1, ui-1), 
ko = f(ti-1 + Di At, uji-1 + cii ki At) 
0 D) 
= Fora ti) +b At + enki Z At + O(At?), 
u 


ti—1 ti—1 
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which implies that u; in (2.25) is 


0 
uj = ujici + fara- ui—1) + a2 (re ui-1) + 24 At 


ti—1 
ð 
f At At 
4 ti—1 


Teu) — 
= uj-1 [aif (ti-1, ui-1) + a2 f (ti—1, ui-1)] At 


At? + O(AP) 


0 D 
+ (ema + amet =) 


Ot ðu / ly 
ð du à 
= uj—| + (a1 + a2) f (ti-1, uji-1) At + a + ume 
ot dt ðu) |r 
x AP + O(AP). (2.26) 


On the other hand, the Taylor series expansion of u; around ft;.-; reads 


d 14d? 
u—uiat—| AtCRICLL  AC-O(AD), (2.27) 
fii 2! dt i=1 
where 

du 

= = f(i-1,u(ti-1)) = f(ti-1, ui-1), 

dt iai 

d^u . af(ti-1,ui-1) (Əf(t, u) "s Of (t, u) du 

JE V dt (XM ÓI ðu dt/|, 


which substituted into Eq. (2.27) gives 


At? 
2 


ti-1 


3-OCAT y. 


Of(t,u) of (t,u) du 
ot ðu =) 


uj = ui—1 + f (ti—1, ui-1) At + ( 
(2.28) 


Comparison of (2.26) and (2.28) implies that 


aj+a=1, 
1 

abı = 7 

1 

a2C11 = 2" 
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which is an underdetermined system of three equations with four unknowns 
41, a2, bj,, and c11, which has an infinity of solutions. Following [1], this system 
can be written in terms of a2: 


a, —1-—a5, 


1 
bi = cy, = —, (2.29) 
2a2 


so that for a given value of a2, different flavors of the method can be constructed, 
all of them within the family of Runge-Kutta methods with second-order accuracy. 
A few specific examples are described next. 


Midpoint method. It is obtained using a? = 1, which implies that aj = 0 and 
bı = c11 = 1/2. The method in (2.25) becomes 
uj = ui—1 + (ayky + aok2) At + O(AP) 
uj-1 + ko At + O(A’), 
ky = fG-1, 4i-1), 


1 1 
kn = f (i + had uj-1 + shar) j (2.30) 


where kz is the slope calculated at the midpoint between ¢;_, and fj. 

Ralston method. It is obtained assuming a2 = 2/3, which implies ay = 1/3 
and bj = c11 = 3/4. The method in (2.25) becomes fully determined through the 
following expressions: 


uj = uj + (aki + a3) At + O(ADC) 
1 2 
= uj-) + E + je) At + OCAD), 
ky = f(ti-1, ui-1), 


3 3 
c f (tort Garni Sar). (2.31) 


Heun method. In this case a? = 1/2, which implies that aj = 1/2, bj = cy, = 1 
and the method (2.25) reduces to 


uj = uj—1 + (aik; + azk2) At + O(A’) 


1 1 
= uj) + (54 + 3 At + O(AP), 


ky = f(ti-1, ui-1), 
ky = f(i-1 + At, ui-1 + ki At). (2.32) 
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In all these expressions, the error O(At?) is local from t;_1 to tj, which, according 
to the analysis in Sect. 2.3, implies that the global error is of second order O(At?). 


Observation. Notice that the expansions above, including the slopes k2, involve 
the evaluation of f in the two arguments (f, u) shifted by an amount proportional 
to At. In all the examples so far, f has been function only of the unknown u. 
Specifically, in the Newton Cooling Law, the right-hand side in (2.2) depends only 
on the temperature T not on the independent variable t. For the Harmonic oscillator, 
notice that the right-hand sides in (2.15) depend only on x and y, but not on t. It 
means that the examples so far are associated to autonomous systems of equations. 

Notice, for example, that Heun method (2.32), for an autonomous system, that is 
when f = f(u), is written as 


1 
ui = uii 5 (kı + kp) At + O(Ar3), 


kı = f(ui-1), 
ky = f(uj-1 + ki At), (2.33) 


is the Average Euler method used to solve the Newton Cooling Law and the 
harmonic oscillator before. 

The description of the three particular cases of second-order RK2 methods above 
illustrates how to implement the numerical solution of nonautonomous systems, 
whose slopes depend on the independent variable as well as on the unknown u. 
We will work out examples of this type later in this chapter, but as for now, it is 
important to illustrate how the three flavors of RK2 methods work for the damped 
harmonic oscillator. These examples will also indicate how to easily program the 
evaluation of the slopes kı and kz that will become more elaborate when dealing 
with higher-order methods. 

We will use this moment to improve the programming. For this we will 
implement the three flavors of second-order Runge-Kutta explained before. This 
time, instead of defining K1,, k2x, and kıy, k»,, we will define two arrays k1 (:) 
and k2(:) of sizes the number of equations NE. For the case of the harmonic 
oscillator, one needs only NE=2, since there are two Eqs. (2.15), one for x and one 
for y. 

Moreover, we will not use arrays x and y; instead we define a two-dimensional 
array u (:,:) of size NE and N. 

We also define an array of slopes rhs (:) of size NE that will provide the right- 
hand sides of the two Eqs. (2.15), one entry of the array for each equation. 

A more important sophistication is the use of a module where global variables 
are declared, which makes easy for any subroutine to make use of such variables. 

The following code rk2 HO. £90 contains the implementation of the three RK2 
flavors described above, midpoint (2.30), Ralston (2.31), and Heun (2.32) for the 
solution of the damped harmonic oscillator (2.15): 
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module numbers 


! arrays 

real(kind-8), allocatable, dimension (:) :: t 

real (kind=8), allocatable, dimension (:,:) :: u 

real(kind-8), allocatable, dimension (:) :: k1,k2,rhs 
real(kind-8), allocatable, dimension (:) :: x ex,y ex,err x,err y 
! parameters 


real(kind-8) x0,y0,omega,m,b,k,alpha,beta 


! Domain 
real(kind-8) tO,tmax,dt 
integer N,resolution label,NE 


end module 


! --» Program starts «-- 
program rk2 HO 


use numbers 
implicit none 


! Counters defined locally 
integer i,j 


resolution label - 1 
NE = 2 

N = 4000 

to = 0.0d0 


tmax = 200.0d0 
N = 2x«(resolution label-1) +» N ! Number of cells for the 
discretized domain 


x0 - 1.0d0 

y0 = 0.0d0 

m = 0.5d0 

k = 2.0d0 

b = 0.05d0 

alpha = 0.5d0 +» b / m ! Parameter for the exact solution 
beta = sqrt(abs(1.0d0 - 4.0d0«k«m/b««2)) ! Parameter for the 


exact solution 


Allocate memory for the various arrays 


| t: time 
|onil:)t X 
I ax(2jj y 


allocate (t(0:N),u(1:NE,0:N) , hs (1:NE) ,k1(1:NE) , k2 (1:NE) ) 
allocate(x ex(0:N),y ex(0:N),err x(0:N),err y(0:N)) 


| ---> PART A «--- 
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dt = (tmax - t0) / dble(N) 
do i=0,N 

t(i) = tO + dt * dble(i) 
end do 


| ---> PART B «--- 
! Set initial conditions 


u(1,0) = x0 
u(2,0) = y0 
do i=1,N 

do j=1,4 


if (j.eq.1) then 
call calcrhs( t(i-1) ,u(:,i-1)) 
kl = rhs 
else 
! if MIDPOINT uncomment the following three lines 
call calcrhs( t(i-1) + 0.5d0 « dt, u(:,i-1) + 0.5d0 » k1(:) 


* dt) 

k2 - rhs 

u(:,i) = u(:,i-1) + K2 x dt 

! if RALSTON uncomment the following three lines 

! call calcrhs( t(i-1) + 0.75d0 * dt, u(:,i-1) + 0.75d0 «x 
k1(:) * dt) 

! k2 = rhs 

! u(:,i) = u(:,i-1) + ( 1.0d0/3.0d0 « k1(:) + 2.0d0/3.0d0 «x 
k2(:) ) * dt 

! if HEUN uncomment teh following three lines 

! call calcrhs( t(i-1) + dt, u(:,i-1) + k1(:) » dt) 

! k2 = rhs 

! u(:,i) = u(:,i-1) + 0.5d0 * ( k1(:) + k2(:) ) * dt 

end if 
end do 

end do 


! ---» Ends Part B «--- 
! Exact solution 
x ex = exp(-alpha«t)»(sin(alpha«beta«t)/beta + cos(alphaxbetaxt)) 
y ex = -alpha«exp(-alphaxt) * (sin(alphaxbetaxt) /beta 
+ cos(alphaxbeta«t)) & 
+ alphaxexp(-alphast) » (cos(alphaxbetaxt) - 
betaxsin(alphasbetasxt) ) 
err x = u(1,:) - x ex 
err y - u(2,:) - y ex 


! Saving data to a file 
open(1,file-'HO rk2.dat') 
do i=0,N,2x» (resolution label-1) 
write(1,x) t(i),u(1,i),u(2,i),x ex(i),y ex(i),err x(i),err y(i) 
end do 
close (1) 


end program 
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! --» Ends program «-- 
! --» Subroutine that calculates the right hnd sides «-- 
subroutine calcrhs (my t,my u) 


use numbers 
implicit none 


real(kind-8), intent(in) :: my t 

real(kind-8), dimension(NE), intent(in) :: my u 
rhs(1) = my u(2) 
rhs(2) = - b / m « my u(2) -k / m « my u(1) 


end subroutine calcrhs 


Notice that the subroutine calcrhs consists in the right-hand sides of 
Eqs. (2.15), whose arguments are evaluated in the independent variable t and 
the unknowns x,y at specific arguments, with names my t, my u(1) and 
my u(2) in the code, respectively. These arguments are given by formulas (2.30) 
for Midpoint, (2.31) for Ralston and (2.32) for Heun methods. 


The resulting solutions are concentrated in Fig. 2.11 where we show the error 
of the numerical solution for the amplitude x, using different resolutions At,, Af», 
and At3. We rescale the errors in order to show the second-order convergence of the 
three methods according to the convergence factor in (2.19) for n — 2. Notice also 
that the amplitude of the error is pretty similar for the three flavors of RK2 described 
here. 


Exercise. Construct your own flavor of RK2. Define an original value for az 
in expression (2.29), and construct the formulas equivalent to (2.30), (2.31), 
and (2.32) for your own method. Program the resulting formulas and produce 
convergence tests similar to those in Fig. 2.11 using the same resolutions. 


Midpoint RK2 Ralston RK2 Heun RK2 


ooz e,(Aty) — ooz e,(Aty) — 002 elti) — 
4e) ---- 4 ejnt) ---- 4e, (AD) ---- 
End 16 e (A5) ons 16 e (A6) ane 16 e,(Ats) 


Fig. 2.11 Convergence tests of the solution calculated using the three flavors of RK2 with 
resolutions At; = 0.05, At; = 0.025, and At; = 0.0125. In the plot we show e, (Ati), 22e. (Ato), 
and 42e, (At3) as defined in Eq. (2.17). The three curves superpose for the three methods, midpoint, 
Ralston, and Heun 
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Fourth-Order Runge-Kutta (RK4) 

We have described in detail the construction of second-order RK methods. Higher- 
order methods can be constructed in a similar way, something we will not develop 
here; see, e.g., [2] for a derivation. Instead we will only use the final result for the 
most popular flavor of fourth-order RK methods. For the generic equation du = 
f (t, u) the method follows the rule: 


1 
uj = ui- + cu 43-2 + 2k3 + k4) At + OQAD), (2.34) 
kı = f(ti-1, ui-1), 


1 1 
kı = f (1-1 + 44^ uj—1 + shar] i 


1 1 
kz= f («1 + 54^ uiid ear) í 


k4 = f(ti-1-- At, uj-1 +k3 At), 


whose local error is of order O(At?) and global error of order O(At^). 
Based on the previous code, the implementation of this formula is straightforward 
as illustrated with the following problem. 


2.9 Workhorse Example 3: Damped and Forced Harmonic 
Oscillator 


It is time to solve an IVP associated to a nonautonomous system of equations. For 
this consider the damped and forced harmonic oscillator whose equation of motion 
reads 


M esto sin(2t). (2.35) 


b 
ï+ itir 
m m m 


This problem can be transformed into the IVP with the following first-order system 
of equations 


x= y 
b k Fo (2.36) 
y= y x+ sin(2t) 
m m m 
to be solved in the domain D = [0, tf], with initial conditions x(0) = xo and 


y(0) = yo. 
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As a particular example, we again fix the physical parameters m — 1/2, k — 2, 
initial conditions x(0) = 1, y(0) = 0, and the domain t = 200. For the numerical 
solution, we define the numerical domain Dg with N = 4000 or equivalently with 
resolution At; = 0.05 and higher resolutions At? = A11/2, Atz = Afo/2, for 
convergence tests. The values of b, Fo, and §2 will be defined later for various 
scenarios. 

For the solution we implement, the fourth-order Runge-Kutta described in 
Eq. (2.34). In this case one needs four slopes k; for each of the variables, which 
needs the definition of arrays k1 (:), k2(:), k3(:) and k4 (:) of size NE=2. 

We also define an array of slopes rhs (:) of size NE=2 that will contain the 
right-hand sides of the two Eqs. (2.36), one entry of the array for each equation. 

We write down the whole program rk4_HO.£90 because it will be the basis 
of the forthcoming particular examples for which only parts of the code will be 
modified: 


module numbers 


! arrays 

real(kind-8), allocatable, dimension (:) :: t 

real(kind-8), allocatable, dimension (:,:) :: u 
real(kind-8), allocatable, dimension (:) :: k1,k2,k3,k4,rhs 
! parameters 


real(kind-8) x0,y0,omega,m,b,k,F0,CapOmega 


! Method and code vars 
real (kind=8) t0,tmax,dt 
integer N,resolution label, NE 


end module 


! --» Program starts «-- 
program rk4 HO 


use numbers 
implicit none 


! Counters defined locally 
integer i,j 


resolution label - 2 
NE-2 

N = 4000 

to = 0.0d0 


tmax = 200.0d0 

N = 2x«(resolution label-1) +» N ! Number of cells for the 
dicretized domain 

x0 = 1.0d0 

y0 = 0.0d0 

m = 0.5d0 
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k 2.0d0 

b = 0.05d0 ! <- 0.0 for the undamped HO 

FO = 0.2d0 ! <- 0.0 for the unforced HO 
CapOmega = 0.5d0 ! <- case A 0.5 case B 2.0 


Allocate memory for the various arrays 


|! t: time 
Luteo X 
! u(2,:): y 


allocate(t(0:N) ,u(1:NE,0:N) , crhs (1:NE) , k1(1:N 
k4 (1:NE)) 


Ej 


),k2(1:NE) ,k3(1:NE), 


| ---» PART A «--- 


dt = (tmax - t0) / dble(N) 
do i=0,N 

t(i) = tO + dt * dble(i) 
end do 


| ---» PART B «--- 
! Set initial conditions 
= x0 


do j=1,4 
if (j.eq.1) then 
call calcrhs( t(i-1) ,u(:,i-1)) 
kl = rhs 
else if (j.eq.2) then 
call calcrhs( t(i-1) + 0.5d0 * dt, u(:,i-1) + 0.5d0 * k1(:) 


* dt) 
k2 - rhs 
else if (j.eq.3) then 
call calcrhs( t(i-1) + 0.5d0 « dt, u(:,i-1) + 0.5d0 * k2 x 
dt) 
k3 - rhs 
else 
call calcrhs( t(i-1) + dt, u(:,i-1) + k3 « dt) 
k4 = rhs 
u(:,i) = u(:,i-1) + (1.0d0/6.0d0)*( k1 + 2.0d0 « k2 + 2.0d0 
* k3 + kA ) x dt 
end if 
end do 
end do 


! ---» Ends Part B «--- 


! Saving data to a file 

open(1,file-'HO rk4.dat') 

do i-0,N,2*x«resolution label 
write(1,*) t(i),u(1,i),u(2,i) 

end do 

close (1) 


42 2 Ordinary Differential Equations 


end program 


! --» End program «-- 
! --» Subroutine that calculates the right hand sides <-- 
subroutine calcrhs (my t,my u) 


use numbers 
implicit none 


real(kind-8), intent(in) :: my t 

real(kind-8), dimension(NE), intent(in) :: my u 

rhs(1) - my u(2) 

vhs(2) -- b / m » my u(2) -k / m « my u(1) + FO / m x 


sin( CapOmega » my t ) 
end subroutine calcrhs 


Notice that the subroutine calcrhs calculates the slope at every point required 
by the RK4. The arguments of this subroutine are the values in the independent 
variable and the unknowns for each intermediate iteration of (2.34). This is the 
crucial subroutine because it defines the equations that are being solved, in our case 
equations (2.36), and this simple program will be generalized to solve a variety of 
IVPs later on. 

Before we solve the damped-forced oscillator, it would be interesting to double 
check that fourth-order convergence is achieved for the simple case b = Fo = 0 
case, whose exact solution is given by Eq. (2.12). 

In Fig.2.12 we show the error e, of the amplitude x and the fourth-order 
convergence toward the exact solution. According to theory, since the RK4 method 
has a global error of fourth order, the convergence factor in (2.19) is expected to 


© 9 o o 
1x107 1x107 
2x107 e (At) -2x107 r e,(Aty) i 
ex(At;) - x - 16 ey(At;) - =x- - j| | 
3x107 -3x107 ji 
4x107 -4x107 
10 20 30 40 50 10 20 30 40 50 
t t 
Fig. 2.12 On the left we show the error of the numerical solution for b = Fo = O0, using 


resolutions Aft; and At. On the right we show that e,(Af,) and 24e, (Ato) lie approximately 
on top of each other, which shows that the numerical solution fulfills (2.19) 
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be 2^ when doubling resolution. The error using resolution At» is actually 16 times 
smaller than the error using At; as shown in the second plot of Fig. 2.12, where we 
have multiplied e, (At) by 2^. 

We now solve the damped-forced oscillator for two cases. 

Case A corresponds to a friction dominated scenario. For this we set b = 0.05, 
Fo = 0.2, and 2 = 0.5. These parameters allow one to see in the time series of 
x(t), the two important phases of this oscillator, a first one in which the amplitude is 
damped by the term bx, where the natural frequency of the oscillator cy = ./k/m = 
2 dominates, and a second phase where the motion is driven by the harmonic source 
Fo sin(£21), which has a slower frequency (2 = 0.5. The results for the time series 
and phase space appear in Fig.2.13. Notice how the phase space picture of the 
system differs significantly from those of the simple or the damped oscillator. 

Case B associated to a growing amplitude regime, for which we use (2 — 2 
and keep the values of all other parameters. The results are shown in Fig. 2.13. The 
phase space picture begins erratical and asymptotically in time it approaches an 
ellipse twice as big as that of the simple case b = Foy = 0. 
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Fig. 2.13 Numerical solution x for Cases A and B and the phase space pictures. For these plots 
we use resolution At; = 0.05 
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Exercise. It would be interesting to program a different source, for instance, 
Fo exp(—(t — tj) /o?), which is a Gaussian pulse of amplitude Fo, centered 
at time f; of approximate duration o. The expected result is that the oscillator 
will respond to the Gaussian pulse, and then the damping term will rule the 
further evolution of the system. 


Improve. Construct the exact solution of the problem (2.35) by adding the 
solution to the homogenous equation and the particular solution. 


Self- Convergence of the Solution 

This is a sufficiently complicated problem whose exact solution is not straightfor- 
ward. Moreover the IVP is associated to a nonautonomous system of equations 
because the right-hand sides of Eqs. (2.36) contain the independent variable t, and 
the evaluation of the slopes used by RK methods in the independent variable, as 
seen in Eqs. (2.30), (2.31), (2.32), and (2.34) becomes useful. 

Knowing that the RK4 method has a global error of order 4, we expect Eq. (2.21) 
to be satisfied for n — 4. 

For the self-convergence test, we calculate the numerical solutions for Cases 
A and B with the code written above. We name x, the numerical solution for x 
calculated with resolution At; = 0.05, x2 the solution using resolution At; = 
At, /2, and x3 the solution calculated with At; = Af, /2. 

The self-convergence test is shown in Fig. 2.14. First we show the difference 
xı — x2 between the numerical solutions x; and x2, together with the difference 
x2 — xa. We also show a zoomed region with the comparison between x; — x2 and 
24 (x5 — x3), showing that Eq. (2.21) is fulfilled. This type of plots illustrate a typical 
self-convergence test of a numerical solution. 


2.10 Extrapolation 


The previous example illustrates the self-convergence of numerical solutions, and it 
is possible to go further. Once we have a self-convergent solution, it is possible to 
approximately estimate the solution in the continuum out of the numerical solutions 
with various resolutions. The theory is as follows. 

Assume we have calculated numerical solutions of the IVP problem (2.1), ul 
using resolution Af), u? using resolution Af1/2 and u? using resolution Af2/2, 
and that self-convergence has been verified. Then an approximate solution in the 


continuum u? can be constructed with two of the three numerical solutions. Notice 
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Fig. 2.14 Self-convergence test for Cases A and B. On the left the differences between numerical 
solutions in the whole time domain without rescaling. On the right we show an inset with the 
difference between x, — x2 compared with 2^(x — x3). The fact of being on top of each other 
indicates that the relation (2.21) is fulfilled 


that we distinguish between the exact solution uf and u?, which we use to denote an 
approximation in the continuum, only. 

If the global error of the method used to construct the numerical solutions is n, 
then we have seen that the numerical solutions can be written as 


ul = u? + E(At)", 


At\” 
2. 0 
pause (Sy. 


Multiplying the second relation by 2” and subtracting 


E 
| 


ul — u? = u? - 2”) => 


E eas 8 (2.37) 
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Fig. 2.15 (Left) Numerical solutions x; and x2 produced with resolutions At; = 0.025 and 


At? = At1/2, respectively, and the extrapolated solution calculated with formula (2.37) for n = 4. 
Difference between the extrapolated solution and the numerical solutions for Case A 


This is an estimate of the solution in the continuum calculated out of ul and 
ur. This expression is called the Richardson extrapolation formula and u? is 
the extrapolated solution. As an exercise, we use this formula to calculate the 
extrapolated solution for the amplitude x of the damped-forced harmonic oscillator 
from the previous section for Case A, whose numerical solution is illustrated in 
Fig. 2.13. 

The extrapolated solution for Case A is shown in the left plot of Fig. 2.15, 
calculated using the numerical solutions x; and x2, with resolutions At; = 0.05 
and At? = Atj/2. In the same plot, we show the extrapolated solution that uses 
(2.37) with n — 4. The two numerical solutions appear on top of each other in the 
left plot, since the numerical resolution used is good. In the right plot, we can see 
that the differences xo — x, and xo — x2 are nonzero. 


Exercise. Calculate the extrapolated solution for Case B. 


2.41 Applications 


In this section we present the numerical solution of various Initial Value Problems 
involving ODEs. 
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2.11.1 Predator-Prey Model 


This model assumes there are two species, species x representing the population 
of prey and species y representing the population of predators. The traditional 
equations describing the dynamics of the two populations are the following: 


d 

= ax — bxy 

A (2.38) 
— = —cy + dxy 


where a, b, c, d are positive constant coefficients and x, y > 0. The term ax > 0 
represents a Malthusian model for the reproduction of the prey; notice that this 
term alone would imply an exponential growth of population x. The term —bxy < 
O indicates that the interaction between the two species will decrease the prey 
population x. The term —cx « 0 indicates that the population of predators, living 
alone, would decrease due to the lack of food; should this term be the only one 
would imply an exponential decrease of population y toward extinction. The term 
dxy > O indicates that the interaction between the two species will represent energy 
and therefore reproduction for predators y. 

Itis straightforward to program a code that solves this system of equations, based 
on the code used for the damped-forced oscillator. One only needs to replace the 
parameters of the system and declare values for a, b, c, d, along with the 
initial conditions xo = x(t = 0) and yo = y(t = 0). The major and most important 
modification takes place in the subroutine calcrhs that should read as follows: 


subroutine calcrhs (my t,my u) 
use numbers 
implicit none 


real(kind-8), intent (in) :: my t 

real(kind-8), dimension(NE), intent(in) :: my u 
rhs(1) = a « my u(1) - b * my u(1) * my u(2) 
rhs(2) = - c » my u(2) + d x my u(1) * my u(2) 


end subroutine calcrhs 


Let us use the code to solve the predator-prey system with the following 
parameters and initial conditions a = 1.25, b = 0.7, c = 0.4, d = 0.25, x9 = 3, 
and yo = 2, in the domain ¢t € [0, 100] using resolution At = 0.1. The results are 
in Fig. 2.16. The interpretation of the solution is that both populations oscillate in 
time with a phase such that when the number of predators y grows, the population 
of prey decreases. When food is not sufficient, the population of predators starts 
decreasing, whereas when the number of predators decreases, the prey have the 
chance to reproduce and increase in number. A common picture of the behavior of 
the system is the phase space portrait, shown in Fig. 2.16, which describes a closed 
cycle. 
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Fig. 2.16 (Left) Solution for the predator y and prey x populations as functions of time. (Right) 
Phase space portrait of the solution 
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The period of the cycle, so as the maximums and minimums of x and y, depends 
on the value of the parameters a, b, c,d. For instance, the effect of changing the 
influence of d, that is, the interaction between the two species from the predator’s 
point of view is shown in Fig. 2.17, producing various solutions. Likewise, the other 
parameters in one way or another also affect the interaction between the two species 
and the amplitude of oscillations of the two populations. 


The Fixed Point 

In the study of dynamical systems, it is said that there is a fixed point when the 
derivatives with respect to t in Eqs. (2.38) are zero. The importance of fixed points 
is whether they are stable, unstable, or saddle points, which can be studied with a 
stability analysis (see, e.g., [3, 4]). System (2.38) has a fixed point in a situation 
where both x and y are time-independent. These conditions are obtained by setting 


dx 20- b 

d = ax Xy, 

d 

2Y Z 0 = —cy + dxy, (2.39) 


dt 
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which has the solution xf = c/d and yy = a/b, where the subindex stands for fixed. 
The theory shows that this point is stable and one can prove this result numerically. 


Exercise. Using the initial conditions x(0) = xy and y(0) = yy, solve the 
system (2.38) with the code, and demonstrate that x(t) and y(t) will remain 
nearly constant in time, or equivalently in the phase space the solution remains 
at one point. Modify the initial conditions slightly with x(0) = xy + € and 
y(0) = yy + €, with e = 0.01, and show the solution describes a closed 
trajectory around the point xf, yy. This would be a numerical evidence of 
(xf, yf) being a stable fixed point. The formal proof of linear stability for 
this system and others in [3, 4] is recommended. 


An interesting variant of this model include the collaborative systems, where 
b,c < 0, in which the growth of one population implies the growth of the other as 
well. An example of this in reality is the bees-flowers system. 

The results discussed here can be reproduced with the code rk4 PP.f90, 
available as Electronic Supplementary Material described in Appendix B. 


2.11.2 SIR Model for the Spread of Diseases 


This is a very basic model for the propagation of an epidemic outbreak. This model 
assumes the existence of three interacting populations: individuals susceptible to be 
infected S, the population of infected individuals 7, and a population of removed 
individuals R. The three populations interact according to the following system of 
equations: 


A = UN — us 87r. 

dI SI 

J B N yl-— ul, 

dR 

a~ yI—uR, (2.40) 


subject to the conditions of N = S + I + R constant and that all the coefficients 
LL, P, y are positive and constant. 

Coefficient jz indicates in the first equation that the number of susceptibles 
increases with the number of infected and removed; notice that u(N — S) = 
I + R). In the third equation, it indicates that population R decreases and 
is transferred to population S, which might mean that the infected individuals 
recover and become susceptible again. Coefficient £ in the first equation indicates 
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the susceptible people, in contact with infected people produces a decrease of 
susceptible population. Notice that the same term appears in the second equation 
with a positive sign, which means that the individuals in the set S are transferred to 
the set J by interaction between infected and susceptibles. Finally y indicates how 
quickly individuals are transferred from infected to removed. 

A normalization that helps analyzing the system consists in defining normalized 
variables s = S/N, i = I/N andr = R/N. The system above written in these 
variables reads 


ds Psi 
— = u — us — psi 
dt Me bh 
di 
— = ßsi — yi — ui 2.41 
qp si yi - ui (2.41) 
dr . 
—=yi-pr 
di yr—Hu 
In this normalization o = v is interpreted as the amount of contacts among the 


normalized populations i and s. The number 1|/, is interpreted as the mean lapse of 
time needed for a susceptible individual to get infected. 

Likewise in the previous example, different values of coefficients B, y, u and 
different initial conditions so = s(t = 0), ig = i(t = 0) and rọ = r(t = 0) will 
imply different results. 

For the numerical solution of this system, one can again construct a code based 
on the previous one that would only need a few adjustments. Firstly the parameter 
defining the number of equations has to be set to NE=3. Secondly one needs to 
declare variables for the parameters u, 6, y in the system (2.41). And finally one 
needs the routine that calculates the right-hand sides of system (2.41) as follows: 


subroutine calcrhs (my t,my u) 


use numbers 
implicit none 


real(kind=8), intent(in) :: my t 
real(kind=8), dimension(NE), intent(in) :: my u 
rhs(1) = mu - mu « my u(1) - beta « my u(1) * my u(2) 
rhs(2) = -mu « my u(2) - gamma « my u(2) + beta 

x my u(1) « my u(2) 
rhs(3) = gamma « my u(2) - mu « my u(3) 


end subroutine calcrhs 


For illustration let us consider two scenarios. 
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Fig. 2.18 Solution of the SIR model, Eqs. (2.41), for Scenario 1. First we show the behavior of the 
three populations in the time domain. Also shown is the dynamics in the si—plane. The infected 
population i approaches zero, whereas the s approaches one, which means the whole population 
becomes healthy asymptotically in time 


Scenario 1. We assume 1/j = 60, y = 1/3, and o = Æ = 1/2. As initial 
conditions we start with ro = 0 and use various initial combinations of susceptible 
and infected populations such that 594-9 = 1, with so = 0.1, 0.2, ..., 0.9. The results 
for these initial conditions are shown in Fig. 2.18, both the evolution in time of the 
three populations and a projection of the phase space diagram on the si—plane. 
Initial conditions are indicated in the phase space portrait with crosses. 

With these values of c, u, y, P, the infected and removed populations approach 
zero and all the population becomes healthy with s approaching one. This can be 
seen both, in the time domain and in the phase space. Notice that the asymptotic 
value of the populations is independent of the nine different initial conditions used. 

Scenario 2. In this case we set the parameters to 1/u = 60, y = 1/3 and o = 3, 
which means that the amount of contacts, parametrized by o is six times bigger 
than in Scenario 1. Again we use initial conditions such that so + ip = 1 with 
so = 0.1, ..., 0.9. The results for different initial conditions lead each population to 
a constant nonzero asymptotic value. This behavior is said to be endemic because 
the three populations coexist with nonzero populations. The results are shown in 
Fig. 2.19. In the time domain ? € [0, 1000], the solution shows that the three 
populations tend asymptotically to a constant. In the phase si —plane, the attractor 
behavior is illustrated by the inward spiral. 

What also happens in this case is that the asymptotic values of the populations 
are independent of the initial conditions. This indicates that parameters u, f, o, 
which are parameters of the disease or of the population behavior, determine the 
asymptotic values. 

This model allows one to learn that the combination of infection's characteristics 
and population's behavior would have different coefficients. For instance, an 
aggressive infection in an undisciplined population would imply a big 8, whereas a 
disciplined health system that recommends individuals to remain at home to avoid 
contact in order to avoid the infection of others will imply a small £. 
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Fig. 2.19 On the left we show the evolution of populations for Scenario 2 and how they converge 


asymptotically in time to a finite value. On the right the trajectory in the phase si—plane for all 
combinations of initial conditions 


All the results discussed here can be reproduced with the code rk4_ SIR. £90 
listed in Appendix B, where we define initial conditions subject to the restriction 
io + so = 1. Then given different values of so, one obtains the associated initial 
value of the infected population ij — 1 — so. The code for the implementation of 
these initial conditions can be as follows: 


do k=0,8 
| initial conditions uí(1,0), u(2,0), u(3,0) 
u(1,0) = s0 + dble(k) « 0.1 
u(2,0) = 1.0  u(1,0) 
u(3,0) = ro 
do i=1,N 
! Here the Runge-Kutta integration 
end do 
end do 


As simple as this, the dynamics of populations can be modeled with ODEs as 
long as diffusion effects are not considerable, which needs the solution of PDEs and 
will be seen later in this book. 


Exercise. Search for coefficients u, y,o that result in a highly infected 
population. 


Challenge. Adapt the code to reproduce the results for the COVID-19 spread 
model in [5], which includes vaccines and mutation. 
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2.11.3 Lorenz System and Chaos 


While studying atmospheric models, in 1962 Edward Lorenz arrived to the follow- 
ing system of equations: 


dx ( ) 

— =a — X 

dt A 

dy 

— —bx—y-— 2.42 
di X—y-—xz (2.42) 
dz 

— — Xy—Cc 

dt P É 


where x is associated to the convective intensity, y to temperature, and z measures 
the deviation from linearity of a vertical profile flow. The parameters are the Prandtl 
number a; the Rayleigh number b, associated to the addition of heat to the system; 
and the aspect ratio of fluid's shear c, concepts that are worth learning from fluid 
dynamics, but not needed to understand the mathematical behavior of the solutions. 

This system of equations became interesting and famous because it shows Chaos 
and because it has solutions with strange attractor behavior. Chaotic behavior is 
related to sensibility to initial conditions and dimension of the system, whereas 
the strange attractor property is related to a bounded phase space-diagram with no 
closed trajectories. See [3, 4] for a complete discussion of this system. 

In order to illustrate the numerical solution of this IVP, we define two scenarios, 
one in which the solution shows an attractor in time solution and a second one 
in which the system shows strange attractor behavior. These two scenarios can 
be achieved by assuming the initial conditions (xo, yo, zo) = (7, 6, 5) with fixed 
parameters a = 15, c = 3 and two values of the parameter b that determine the two 
different behaviors. 

Case A, the fixed point attractor regime. In this case we set parameter b = 20 
and solve the system in the time domain t € [0, 100]. The resolution is an important 
issue, and in order to achieve convergence, one needs to use a rather high one; 
specifically we set At — 0.001 or equivalently N — 100,000. 

The numerical solution with these parameter values is shown in Fig. 2.20, where 
the three variables x, y, z approach a fixed point value in the time domain. Also 
in the phase space portrait, the trajectory oscillates between two loops and finally 
spirals down toward the center of one of them. 

This is a nonlinear sensitive system and we want to practice a self-convergence 
test. For this we construct solutions x1, x2, x3 that use resolutions At; = 0.001, 
Ato = At1/2, At3 = At»/2, respectively. We show the results in Fig. 2.20, in the 
time window before the asymptotic behavior t € [0, 35]. Notice that xı —x2 is nearly 
24 times bigger than x2 — x3, which confirms the theory in (2.21) and validates self- 
convergence. 

Case B, the strange attractor regime. This case can be illustrated with the 
parameter value b = 30 and all other parameters and initial conditions as before 
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Fig. 2.20 (Top) Solution of Lorenz system (2.42) for Case A. First we show the dynamics in the 
time domain and then the phase space diagram. The behavior in both pictures shows a late-time 
attractor behavior toward a fixed point. (Bottom) Self-convergence test for the variable x showing 
(x1 — x2) and (x2 — x3). On the right we show (x, — x2) and 2^ (x5 — x3) that approximately 
superpose 


a = 15,c = 3, xg = 7, yo = 6, zo = 5, in the time domain ¢ € [0, 100] using 
resolution At = 0.001. In this case the three time series do not approach a fixed 
attractor value; instead, the time-series of x, y, z bounce between very different 
values as shown in Fig. 2.21. In the same Figure, we also show the famous Lorenz 
attractor phase space diagram. 

This is one of the canonical examples used to illustrate Chaos, partly because the 
solution does not seem to follow a pattern and partly because the system is sensitive 
to initial conditions. In order to show the later property, we solve the system with 
parameters a = 15, b = 30, c = 3 and initial conditions slightly different from 
(xo. yo, zo) = (7, 6, 5): 


(xo, yo. zo) = (7.001, 6, 5), 
(xo, yo, zo) = (7, 6.001, 5). 
The results for the variable x using these two initial conditions are shown in 


Fig. 2.22, where by t ^ 10 it can be seen that the two solutions depart from each 
other, which illustrates the sensibility to initial conditions. 
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Fig. 2.21 Solution of Lorenz system (2.42) for Case B using the initial conditions (xo, yo, zo) = 
(7, 6, 5). We show the dynamics in time domain of x, y, z and the phase space diagram. The 
behavior in both pictures does not show a late-time attractor toward a fixed point, instead it shows 
the strange attractor behavior 


These results can be reproduced with the code xk4 Lorenz.f90, available as 
Electronic Supplementary Material described in Appendix B. The difference of this 
code with the previous ones is the part that calculates the right-hand sides of system 
(2.42) and the part providing parameter values and initial conditions. In this case 
we identify u(1,:), u(2,:), u(3,:) with x, y and z respectively, and the 
routine that calculates the right-hand sides of the system reads: 


subroutine calcrhs (my t,my u) 


use numbers 

implicit none 

real(kind-8), intent(in) :: my t 

real(kind-8), dimension(NE), intent(in) :: my u 


rhs(1) = a * ( my u(2) - my u(1) ) 
rhs(2) = b « my u(1) - my u(2) - my u(1) x my u(3) 
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rhs(3) = my u(1) * my u(2) - c * my u(3) 
end subroutine calcrhs 


In this very important and famous case, it is not enough to show the phase space 
picture; instead one has to make sure the numerical solution self-converges in the 
regime where one sees departure of the solutions with very similar initial conditions. 
We thus prepared a self-convergence test with the numerical solutions for the 
variable x labeled x1, x2, x3 calculated using resolutions At; = 0.001, Af» = 
0.0005, At4 = 0.00025, respectively. The results are shown in the bottom of 
Fig.2.22, where we show that x; — x2 is nearly 16 = 2^ times bigger than 
X2 — x3, which, according to theory (2.21), means the numerical solutions for x 
self-converges in this time-window. 

Then one can claim that we have constructed a self-convergent numerical 
solution of the Lorenz system with the parameters and initial conditions of Case 
B corresponding to the strange attractor regime in the time window t € [0, 20]. 


(Xo Yo.zg-(7.6.5) — (Xo.yoZ)-(7.6.5) — 
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Fig. 2.22 (Top) Two solutions for the variable x using slightly different initial conditions. Notice 
that they start being different after t ~ 10. (Bottom) Self-convergence test for x showing (x1 — x2) 
and (x2 — x3) for the initial conditions (xo, yo, zo) = (7, 6, 5). On the right we show (x1 — x2) 
and 2^ (x? — x3) that approximately superpose. Similar plots can be constructed for the variables y 
and z 
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Exercise. Investigating what happens after t = 20 is interesting. Verify that 
the numerical solution does not self-converge after t ~ 30 even using further 
refined resolutions At, = AD Nig = At, /2^, Ate = At, Pe, A = 
At, /26, Ats = At; /27. 


With the experience gained in this section, we would like to invite the reader 
to solve the Lorenz system using higher-order methods that should be easy to 
implement now, analyze the solution in bigger time windows, and check self- 
convergence. An example of a sixth-order accurate Runge-Kutta method that can 
be easily implemented can be found in [6]. 


2.11.4 Simple Pendulum 


This is a case similar to the harmonic oscillator. A clear important difference is that 
the spatial coordinate is now periodic, which leads to interesting physical results we 
are to explore numerically. 

The degree of freedom of the system is associated to the angle of the pendulum. 
Following the convention in Fig. 2.23, where @ = 0 corresponds to the vertical 
position, the equation of motion for the angle of the simple pendulum is 


d$ s. 
go mp ew 


that can be simplified by rescaling time t = £4/g/1, such that the equation reduces 
to 


Po 
dà + sing — 0. (2.43) 


Fig. 2.23 Illustration of the 
pendulum and the convention 
we use to measure the angle 
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The system is conservative and it is possible to define an energy function as follows: 


— —- + —sin$ —0 


dod? d$. = d [1 (do ? . dE 
dt dt? dt ` B 


where E is the energy. Now we write Eq. (2.43) as a system of two first-order 
equations: 


(2.44) 


— = —sin$ 


where 7 is the angular velocity. The energy in terms of these variables reads 


1 /d9 M? 1 
EG. - 5 ($) — cosġ = 51" — cos, 


and the theory indicates that constant values of this functional determine the 


trajectories of the system in the phase space @7. We illustrate this in Fig. 2.24, where 
we show the isocontours of E($, 7) in the domain ($, n) € [—10, 10] x [—4, 4]. 


Fig. 2.24 Energy of the 
pendulum as function of $ 

and 7. The isocontours of E 
correspond to accessible 
trajectories of the system in 

the phase space E 
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There are two types of interesting points. In the Figure, points ($, n) = (—2z, 0), 
(6,5) = (0,0), (6, n) = (27,0) correspond to local minimums of E and the 
phase space trajectories near them are ellipses, like those for the simple harmonic 
oscillator. 

Points like (6,5) = (—37,0), (6,9) = (=x, 0), (6,9) = Gr,0), (6,0) = 
(3x, 0) are saddle points in the phase space that can be seen in the left plot of 
Fig. 2.24. They are local maximums along the line 7 = 0 and minimums along the 
lines  — —37z, —7,7,37. 

We proceed to solve the system (2.44) using the RK4 solver for given initial 
conditions $(0) = ġo and 7(0) = no. Let us assume initial conditions $9 = 0 
and no taking various values. This means that the initial position of the pendulum is 
vertical and has a given initial angular velocity. For this we set the initial velocity 
to no = —5 + kóno, with dno = 0.25 and k = 0, ..., 40. The resulting phase space 
diagram of the numerical solutions appears in Fig. 2.25. 

The initial velocity no ranges from negative to positive values, which results in 
trajectories moving initially to the right in the $5— plane and trajectories moving to 
the left, respectively. Some trajectories remain bounded, and others extend toward 
the outskirts of the domain in the Figure. The cases of trapped trajectories have a 
negative energy, whereas those extending toward infinity have positive energy. We 
indicate the values of the Energy in the Figure for some of the trajectories. 

Notice finally that these phase space trajectories resemble those pictured in 
Fig. 2.24 although partially. The phase space can be completed by solving the IVP 
with a bigger set of initial conditions. Also observe that for negative energies we 
only draw the trajectories around the minimum of E at (¢, n) = (0, 0). In order to 
construct trajectories around ($, n) = (—2z,0) and ($, n) = (27, 0), one has to 
start with values of $o at a different branch. Using the same initial conditions for 
no but this time $9 = —27r, one will produce the trajectories at the top-left zone of 
Fig. 2.25, whereas setting $9 = 27 will fill the right-bottom zone of the diagram. 
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We do not discuss the code used for solving this system here, because we next 
solve the damped pendulum, where we describe the code that includes the ideal 
pendulum as a particular case. 


Exercise. Within the code provided below, program the appropriate initial 
conditions required to fill the blank spots in the phase space diagram of 
Fig. 2.25. 


2.11.5 Damped Pendulum 


We start by generalizing the simple pendulum Eq. (2.43) by adding a friction term 
as follows: 


AT (2.45) 
— — + sing = 0, ] 
dt? dt 

where the term in the middle plays the role of friction for b > 0 and will damp the 
motion out. Recalling that the energy of the system is E = 1 (ay? — cos $, the loss 


of energy goes like 
dE d (1f(d$M 2 
= = —b 
dt dt (; (4) cose) 9. 


which eventually provokes the pendulum to settle at rest independently of the initial 
conditions. 

Unlike the simple pendulum, isocontours of E do not define the phase space 
trajectories since E is not conserved in this case, and the phase space diagram will 
be constructed by solving the evolution equation for a bundle of initial conditions. 

Let us explore the phase space diagram to see the effects of the damping for 
b = 0.1. Numerical solutions are calculated using At = 0.1 in the time domain 
t € [0, 100]. The results are shown in the left plot of Fig. 2.26. We show the diagram 
for the same initial conditions used to generate Fig. 2.25. The loss of energy brings 
the system toward attractor points, which happen to be the minimums of the energy 
functional of the ideal pendulum in Fig. 2.24. The trajectories that were ellipses 
in the frictionless case are now inspirals toward the central attractor point (0, 0). 
Some of the trajectories that led the system toward the far left or far right of the 
diagram in Fig. 2.25 in the frictionless case are now trapped at the attractor points 
($, n) = GE2kr, 0). 

A more appealing phase space diagram can be generated easily by choosing a 
wider range of initial conditions. At the right of Fig. 2.26, we show the diagram for 
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n(0)-5, E(0)=11.5 
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Fig. 2.26 (Top) Phase space diagram for the damped pendulum. The case for b = 0.1 and the 
same initial conditions as for the friction-less case in Fig. 2.25. (Bottom) The case with b = 0.5 
and a wider range of initial conditions that illustrate how the system evolves toward the attractor 
points of the system 


b = 0.5, with initial conditions for $9 = 0 and no ranging from —10 to 10. The 
result shows a good-looking sequence of attractor points. 

The code rk4_ Pendulum. £90, available as Electronic Supplementary Mate- 
rial described in Appendix B, generates these solutions and phase space diagrams 
uses a right-hand side routine that reads as follows: 


subroutine calcrhs (my t,my u) 

use numbers 

implicit none 

real(kind-8), intent(in) :: my t 

real(kind-8), dimension(NE), intent(in) :: my u 


rhs(1) = my u(2) 
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rhs(2) = - b » my u(2) - sin( my u(1) ) 


end subroutine calcrhs 


DO ics - 0,80 ! 40 for simple, 80 for nice pic 
| ---» PART B «--- 
! Set initial conditions 
u(1,0) = phiO 
u(2,0) = dotphiO + dble(ics) * 0.25 ! Changes the value of 
dotphiO 
! Integration loop along t 
do i=1,N 
! RK4 loop 
! Save data 
end do 


END DO 


Basin of Attraction. We use the case b = 0.5, whose phase space trajectories 
are on the right of Fig. 2.26, to illustrate how a given domain of initial conditions 
approaches asymptotically in time toward one of the attractor points. It can be seen 
that the initial conditions with no = —10, —9.75, —9.5, —9.25 in the phase space 
end up in the attractor point (—6:7r, 0). It is then said that these initial conditions 
belong to the basin of attraction of this particular attractor point. 

One challenge is to investigate the basin of attraction of each attractor point. By 
slightly generalizing the code, one can explore the initial conditions for which the 
system ends at the attractors points. 

A simple strategy is to define a bundle of uniformly distributed initial conditions 
within the domain (ġo, no) € [—10, 10] x [—10, 10]. For example, by setting initial 
conditions $o,; = —10 + 0.1j and yo; = —10 + 0.17, with j = 0, ..., 200. This 
implies solving 200 x 200 IVPs, from which one can select those that asymptotically 
in time approach a particular attractor point. Keeping in mind that the time domain 
is f € [0, 100], and labeling an attractor point as ($4, 74), we check whether the 
condition 


($(100) — $4? + (n(100) — na)? < €, (2.46) 


where e > O is a tolerance, is fulfilled or not for each of the initial conditions 
around each attractor point. If the condition is fulfilled, we save the position of initial 
conditions in a file we can plot; otherwise we do not save it. With this criterion we 
show in Fig. 2.27 the basin of attraction for the three attractor points in the chunk of 
phase space [—10, 10] x [—10, 10] and for initial conditions also restricted to this 
domain. 

There are still other interesting subjects to analyze with the code, for example, 
it would be interesting to study the behavior of the system at bifurcation points 
((2k + 1)z, 0). 
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Fig. 2.27 Basin of attraction 10 gm 
of the three attractor points in 
the domain 

[—10, 10] x [—10, 10], for 
the damped pendulum with 

b — 0.5 
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Exercise. Program the appropriate initial conditions required to fill the blank 
spots in the phase space diagram of Fig. 2.26. 


Exercise. Reproduce Fig. 2.27. 


2.11.6 Polytropic Star Models with Spherical Symmetry 


The goal of this example is to show that three-dimensional problems with certain 
symmetries can be rewritten as ODEs and also how to handle subtleties emerging at 
the coordinate origin sometimes when using spherical coordinates. 

For example, if one wants to solve Poisson equation V? = 4rrp for a spherically 
symmetric system, it is helpful to use spherical coordinates. The spherical symmetry 
means that $ = ¢(r) and p = p(r); then writing the Laplace operator in spherical 
coordinates, Poisson equation reduces to 


1 d (do 
a (2) — 4np(r), (2.47) 


where all the terms depending on the angular coordinates vanish. Then the 3D 
problem is reduced to an ordinary differential equation that can be solved as an 
IVP. 

The idea of this application is to solve the equations of a Tolman-Oppenheimer- 
Volkov (TOV) star model [7]. The TOV star model is a stationary solution to 
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the Euler-Poisson system. The system consists of a fluid that generates its own 
gravitational field, in a situation where the gravitational field and the pressure of 
the fluid compensate each other, so that the fluid remains in hydrostatic equilibrium. 

The star is made of a fluid that obeys Euler equations of hydrodynamics for an 
ideal fluid: 


ap + V - (pv) = 0, 
9/(ov) + V. (v & pv) + Vp = —pV6, 
& E + V. [CE + pv] = —pv- Vó, (2.48) 


where p, v, and p are the density, velocity field, and pressure of a fluid volume 
element, with total energy E — pv? +e), where e is the internal energy related to 
p and p through an equation of state (EoS), and finally @ is a potential responsible 
for a force acting on the fluid, which in our case will be the gravitational potential 
sourced by the fluid itself, which is solution of Poisson equation V?^$ = 4rrp. In 
general, all variables involved depend on time and space. 

We will come to these general equations in a later chapter where we deal with 
PDEs; here we only look for spherically symmetric and stationary solutions of 
these equations. The spherically symmetric version of Eqs. (2.48), in which all the 
variables depend on time and the radial coordinate reads 


a 108 


2 
EIA Se = 0, 2.49 
ot ý r? or (p) (249) 
ð 185,5 5 ap _ 0d 
tt T Pa a Par 
JE 198,5 0o 
e oae cue E ——D——. 
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where v is the radial component of the velocity field. A key issue in problems related 
to hydrodynamics is that this system of equations is underdetermined. There are four 
equations for five variables p, v, E, p, 9. An EoS is used to close the system that 
relates p, E, p. The polytropic EoS p = Kp” is very popular, suitable for isentropic 
processes, where K — po/ pu is a constant defining a reference thermodynamical 
state of the system and y = cy/cy is the adiabatic index resulting from the ratio 
between the specific heat capacities at constant pressure and volume. This is the 
EoS used to construct the TOV star model. For the adiabatic index, we will use 
y = 5/3, which is a suitable value for a simple gas made of particles moving at 
nonrelativistic speeds. 

Assume additionally in (2.49) that the system is time-independent if one expects 
the pressure and gravitational field to compensate each other in equilibrium. This 
implies that the variables do not depend on time and that v — 0, which reduces the 
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system to two nontrivial ODEs: 


dp | dé 
dr i dr’ 
d d 
zx (^5) = 4x Gr?p, (2.50) 
r r 
which are usually rewritten considering do = on d= ?. because the force 
produced by a sphere of radius r containing the mass m(r) acting on a test particle 
of mass Mrest at position r is F = — S mes, = -G7 Oes, Notice that the relation 


between ae and m(r) is actually the definition of the first derivative of $ as a new 
variable, as done in all the previous examples involving second-order equations. 
This implies that 


£ (aa) = Anffr? p, (2.51) 


and therefore one ends with a system of three first-order ODEs: 


d 
» ES Anr?p 
dp m 

Ep 2.52 
dr y ( ) 
dó m $ 

— G = 
dr r2 r 


which is a system of equations for m(r), p(r) and $(r). We set the domain of 
integration from the origin until a maximum radius r € [0, Fmax] that we discretize 
like we have done so far, Dg = (ri = iAr},i = 0,..., N, with Ar = rmax/N 
for a given N. The IVP is now formulated with the following initial conditions 
corresponding to values of the unknown functions at the origin, and the numerical 
solution will be m;, pi, $;. Given the central value of density pec, the initial/central 
conditions are: 


1. For the mass m (0) = 0, since the integrated mass at the origin is zero. 

2. For the pressure we use the polytropic EoS p(0) = Kp , where pe is the central 
density of the star. 

3. Finally, the potential $ (0) = ġe is an arbitrary constant. Its value at the origin is 
irrelevant because according to (2.52), the potential can be rescaled multiplying 
by a constant, for example, using any value of ġe one can always rescale the 
potential: 


Drmax) 
Qrescaled = — —,—— —.(r) (2.53) 


Tmax? (max) 
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so that the known value of the potential at the outermost point of the domain is 
Q (Fmax) = — Emax) . This scaling works as long as œc is sufficiently negative so 
that (Fmax) 1s negative too and the previous expression does not change sign. 


Given y and K, properties of the fluid, the central value of mass density p. is the 
only free parameter of the solution that distinguishes one star from another. This 
means that each p. is the parameter that labels the family of solutions for the pair 
(y, K). 

The origin is another important concern because Eqs. (2.52) seem to be singular 
atr = 0. Fortunately, since m(r) is also zero at the origin, one can investigate 
whether the equations are regular at the origin, for which we develop the Taylor 
expansion of the mass function 


m'(0) = Ax r?p|o = 0, 
m" (0) = 4x (2r0 +r’ +) lo = 0, 
m” (0) = Ax (2p + 2rp' +r? o" +2rplo = 810. => 


m ~ m(0) +m’ (0) + im Or? + en"? + O(r^) 


Boo Only. 


This expansion indicates that the singularity can actually be compensated by the 
smallness of the mass near the origin, because the mass approaches zero faster than 
the denominators in the singular terms of the equations. Therefore the equations for 
p and $ when r < 1 can be approximated as follows: 


dp 4nG pr! 4 Go? 
= = — -n Gp'fr, 
dr ps "Ld 
dọ G Ampl 4 
=—. = —nGor, 2.54 
de y 3 3 ^ TA 


which are regular and can be used instead of those in (2.52) for the first grid points 
of Dg where r < 1, when integrating the ODEs. In practice the right-hand sides 
in (2.54) are used only to integrate the equation from the first point of the discrete 
domain ro = 0 to the second one rı = Ar. From this point of the discrete domain 
on, the right-hand sides used for the integration are those in (2.52). 

The code that solves these equations uses the same technology as in the previous 
examples. One only needs to define initial conditions, which in this case are values 
of the functions at the origin, and use the appropriate right-hand sides there. We 
consider the domain Fmax = 20 that we discretize with N = 1000 or equivalently 
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the resolution Ar — 0.02. The initial conditions in the code are 


resolution label - 1 
NE = 3 

N = 1000 

to = 0.0d0 

tmax = 20.0d0 

moO = 0.0d0 

rhoO = 0.01d0 

phio = -5.0d0 

K = 10.0d0 


gamma = 1.666666666 

N = 2x«(resolution label-1) « N ! Number of cells for the 
dicretized domain 

pi = acos(-1.0d0) 


GG = 1.0d0 ! We use the gravitational constant set to one 


For the right-hand sides, there are two subtleties. First, notice that o appears 
in the equations for m and p. This density can be calculated from the equation 
of state o = (p/K)'/” before calculating the right-hand sides (2.52) and (2.54). 
Second, since the density is positive, it can only be calculated when p > 0. During 
the numerical integration, it might happen that the pressure could become negative 
because it is a number resulting from a numerical calculation. In that situation we 
have to prevent the density from becoming negative. Then we need to lock its value 
with the condition that o = max(0, (p/K 3 Y). In fact, the radius of the star r,;4; 
can be defined as the radius at which the density is zero. 

Considering these details, the code for the right-hand sides of this problem reads 


subroutine calcrhs (my t,my u) 


use numbers 

implicit none 

real(kind-8), intent(in) :: my t 

real(kind-8), dimension(NE), intent(in) :: my u 
real(kind-8) rho here 


if (my u(2).9t.0.0d0) then 


rho here = ( my u(2) / K ) x«(1.0d0/gamma) 
else 

rho here = 0.0d0 
end if 
rhs (1 4.0d0 * pi * my tx«2 » rho here 


) = 
if (my_t.le.dt) then 
= - 4.0d0 * pi * GG « rho here««2 » my t / 3.0d0 
= 4.0d0 « pi * GG « rho here x my t / 3.0d0 
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rhs(2) = - GG « my u(1) * rho here / my t««2 
rhs(3) = GG « my u(1) / my tx«2 
end if 


end subroutine calcrhs 


where we keep our notation my t for the independent variable, in this case the 
coordinate r. Notice that in order to avoid overflows, we first ask whether the 
pressure is positive or not and make the choice to set the density to the value from 
the EoS or to zero. Also notice that we use (2.54) for pressure and gravitational 
potential when r < Ar and (2.52) otherwise. 

It is now straightforward to construct equilibrium configurations of TOV stars. 
Results for the case with o, = 0.01, K = 10, and y = 5/3, using ġe = —5 are 
shown in Fig. 2.28. 

The central density starts with the central value p¢ and decays with radius, 
whereas the pressure follows a similar profile, since these two quantities are related 
through the EoS p = Kp”. These functions decay until they acquire a small enough 
value. The mass function m (r) is the integral of p and grows until the density is very 
small. From there on, the mass is nearly a constant function of r. The mass of the 
star can be defined as M = m(rga). 

For the integration of the gravitational potential, we use the central value $ (0) = 
—5, and after rescaling with (2.53), the central value is nearly —0.7. Remember that 
this rescaling was set for the potential satisfying the condition $ (Fmax) = —M / fmax 
at Fmax- 

Going further, it is usual to construct a whole family of equilibrium solutions 
for different values of o. for each pair of K and y. This family is presented in 
M vs p. and M vs Fstar diagrams. In Fig. 2.29 these two diagrams are shown for 
K = 10, y = 5/3. Notice that the mass grows with the central density, whereas 
the radius of the star decreases. This behavior is contained in the third plot in this 
Figure, where the compactness of the star M/rsrar vs pe indicates that the star's 
compactness grows with the central density. 

The diagrams can be implemented by adding a loop that changes the value of pe 
within a range and a discrete set of values separated by êpe. 


Fig. 2.28 Density p and pressure p, mass m and gravitational potential $, for a TOV star with 
parameters pe = 0.01, K = 10, and y = 5/3 
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Fig. 2.29 Diagrams M vs pe, rs;4, VS Pc and compactness for the family of solutions with K = 
10, y — 5/3, and for a range of values of the central density 


The code used to construct these solutions is rk4_NewTOV. £90, available as 
Electronic Supplementary Material described in Appendix B. 


Exercise. Construct M vs p, curves like the first one in Fig. 2.29 using values 
of y between 1 which corresponds to a pressure-less fluid and 4/3, appropriate 
for relativistic gases. 


2.11.7 Polytropic Relativistic TOV Star Models with Spherical 
Symmetry 


A relativistic Tolman-Oppenheimer-Volkoff (TOV) relativistic star is a solution of 
Einstein’s equations G, = 8x T,,,, sourced by a perfect fluid defined by the stress 
energy tensor: 


T'"" = pohu"u" + pg", (2.55) 
usually written also as 
Th = (p + pyu"u" + pg"". 


Each fluid element is described by the rest mass density oo, total energy density 
p = po(1 + e), specific enthalpy h = 1 + e + p/ po, internal energy e, pressure p, 
4-velocity u”, and g"" is the 4-metric of the space-time, being all these quantities 
local at the position of a fluid element [7]. 

Like in the Newtonian case of Sect. 2.11.6, the polytropic name arises from the 
isentropic equation of state (EoS) imposed on the fluid that relates pressure and rest 
mass density p — K Po where y is the adiabatic index and K a polytropic constant. 

Because it is useful, we remind the reader that the line element of the space- 
time ds* = Suvdx" dx", for x” labeling coordinates of the space-time, for the 
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Schwarzschild black hole in Schwarzschild coordinates reads 


r 


2M dr? 
ds? = — ( = 2) di? + ED + r2 (d0? + sin? 649?) (2.56) 
E 
1 


where (t, r, 0, $) are the coordinates of the space-time. The assumptions in the 
construction of this solution are that (1) the space-time is assumed to be vacuum, 
that is 7,,, = O, (ii) the space-time is spherically symmetric, and (iii) the space-time 
is static. Birkoff's theorem ensures that Schwarzschild solution is the only solution 
under these conditions [8]. 

TOV stars will be constructed by relaxing condition (1) at the price of adding 
new conditions, namely, (a) that the solution will be regular at the origin and (b) 
that asymtotically the solution will approach Schwarzschild solution. Condition (a) 
is consistent with the idea that stars have no singularities, whereas condition (b) 
is consistent with the fact that far away from the star's surface the solution will 
correspond to vacuum and consequently should match the solution in vacuum. 

The relaxation of condition (1) will be introduced as follows, in the line element 
(2.56), where M is a constant of integration (see, e.g., [8]). We relax the condition 
by allowing M to be a function of r, M — mí(r). In this way the line element 
becomes 


ds? = —a (rd? + ——— ES r^d0? + r° sin? 049, (2.57) 


- e) 
where g; = a(r)? is a positive function associated to the gravitational potential that 
not necessarily will equal 1 — amir) like in the vacuum case (2.56). 

Assuming spherical symmetry means that all the state variables of the fluid 
depend only on r. Notice that none of the metric functions depends on time f, 
which is consistent with stationarity, whereas the fact that ds? is invariant under 
the transformation t — —t ensures staticity of the space-time. 

Now we are in position of writing Einstein's equations G4” = 8z T^". The 
resulting equations can be cast in a form very similar to that of equations for 
Newtonian TOV models of the previous Section. The uw = v = O and y = v =r 
components of Einstein’s equations, and the y = r component of the divergence 
free condition on the stress energy tensor 7"".,, = 0 become the following set of 
three independent equations (see, e.g., [8]) 


d 

a” =4nro, (2.58) 
dr 

d m Arr? 2m\ T! m + Az r? 
Ts- o4 p) 1+ p 1 = —(pcp——— £ 
dr p m r r(r — 2m) 


(2.59) 
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1l da 1 dp _m+4nr>p 


adr p+pdr  r(r—2m) 


(2.60) 


This is a system of ordinary equations whose solutions will represent relativistic 
stars. Like in the Newtonian case we integrate the equations as an IVP in the domain 
r € [0, r max], outwards from r = 0 up tor = Fmax, on the numerical discrete 
domain Dg = (rj = i Ar) fori = 0, ..., N, and resolution Ar = rg4*/N, using the 
fourth-order Runge-Kutta method. Assuming we provide a central value of the rest 
mass density poc, the conditions at the origin are: 


1. For the mass m(0) = 0, since the mass at the origin is zero. The consequence is 
that g,,.(0) = 1, which means the space is flat there. 

2. For the pressure p(0) — K Po, cœ Where poc is the central value of the rest mass 
density of the star. 

3. Finally, «(0) = oo is arbitrary. Its value at the origin is irrelevant because 
according to (2.60), the solution can be rescaled multiplying by a constant. 


Given y and K, properties of the fluid, the central value of rest mass density 
poc is the only free parameter of the solution. This means that each TOV star will 
be characterized by poc and one can construct families of solutions in terms of this 
parameter for the pair (y, K). 

Notice that the right-hand side in the equation for m is the total energy density p, 
which must be distinguished from the rest mass density po. The total energy density 
is the rest mass density plus the internal energy o = po(1 + e). The calculation of 
internal energy needs an additional condition, for example, the ideal gas equation of 
state p = poe(y — 1), from which the internal energy is e = CDS We use this 
expression for the internal energy to write the total energy density p in terms of the 
variables involved in the system: 


= e—[— 
p po 90 K 


P 


yel (2.61) 


which is the expression used in the right-hand side of Eqs. (2.58)-(2.60). 

Notice also that Eqs. (2.59) and (2.60) seem to be singular at r — 0. Nevertheless 
a Taylor series expansion reveals that the factor (m + Az r? P)/(r(r —2m)) is regular. 
For this we write the Taylor series expansion of this factor around r — 0: 


m-Anr)p | m(0) +m'(0)r + 3m" O)r? + 1m" (0)? + 0(7*) + An? p 
ri-2mr — r-2r(m(0)- m (O)r + 3m" (O)r? + qm" O)r3 + O(r4)) 


_ 4npr[3 4 Anrp 
^ — 1-8zpr?/3 ' 


(2.62) 


where the derivatives of m use Eq. (2.58), that is, dm/dr|,-o = 4zr?p|,-9 = 0, 
d*m/dr?|--9 = 4x rp + r?p)|,-9 = 0, and d?m/dr?|,-o = 4x (2p + 2rp + 
r?p)|,—o = 82. With these results, Eqs. (2.59) for pressure and (2.60) for o near 
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the origin are 


dp _ oe p 
dr ^ PT Bar? 3 
Lda _ 4rpr/3 +4rrp 


adr | 1—8zpr?/3 


(2.63) 


regular at the r — 0. These equations are used to solve the system from the origin at 
ro = r(0), until rı = Ar, which is the second point of the discrete domain Dy. 

Like in the Newtonian case, a subtlety is that when integrating the pressure, it 
may become negative, and therefore the rest mass density would be negative as well, 
which would be unphysical. In order to avoid this problem, one imposes a condition 
for the density to be non-negative, known as the implementation of an atmosphere. 
In order to guarantee the positiveness of rest mass density, we set 


oy = max ((2)” D (2.64) 


With this, we now have all the ingredients to integrate the equations and construct 
TOV star configurations. 


Diagnostics. With the numerical solution, it is possible to calculate physical 
properties of the resulting configurations. The radius of the star is calculated as the 
smallest value of r = R for which oo = 0. The total mass of the star can be defined 
as M — m(R) and the rest mass of the star is given by the integral of the rest mass 
density in the numerical domain Mo = 47 [à por? /grrd r. The difference between 
the total mass M, and the rest mass Mo of the star is the binding energy of the star 
Ep = M — Mo. 

Finally an additional scaling of o. In order for the space-time line element (2.57) 
to mimic the property gr = 1/2,, of Schwarzschild metric (2.56), one can scale the 
solution o such that æ (Fmax) = 1/ V1 — 2m(rgax) /rmax as follows: 


alr) = "n 1 = 


Let us finally construct TOV stars for two invented cases with y = 2 and K = 1 and 
two central densities poc = 0.3, 0.6, in the domain with Fmax = 5 using N = 1000 
or equivalently resolution Ar = 0.005. The results are shown in Fig. 2.30. 

Notice that the metric functions g;; = o? and Err = my tend to one as r 


grows, approaching, in these coordinates to the Minkowski flat space-time metric. 
Notice also that the configuration with higher central density poc has space-time 
metric components g;; and g,, that depart more from 1. 
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Another interesting property is that in the two examples Mo > M, which implies 
that the binding energy Eg = M — Mo < O, and consequently the system is 
gravitationally bound. 

Beyond these two examples, it is possible to construct families of solutions in 
terms of the central density oo. for given pairs of K and y. This is usually done by 
solving the TOV equations for various values of po. and compiling the results into 
a M vs poc diagram. 

The results for two families of solutions are shown in Fig.2.31. The maximum 
of the curves, marked with squares, indicate the stability threshold, those config- 
urations to the left from the maximum define the stable branch of configurations, 
whereas those to the right from the maximum define the unstable branch of the 
family of solutions. 

Other important point indicated with a star is that where the binding energy Eg = 
M — Mo changes sign from negative to positive. This means that solutions to the 
right from the star have a positive binding energy, and theoretically they should 
explode when perturbed. Those configurations between the square and the star are 
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Fig. 2.31 Diagrams M vs po. for the families of solutions with K = 10, y = 5/3, and K = 
50, y =2 


gravitationally bound and unstable, and their fate is theoretically the collapse into a 
black hole as seen in [9]. 


The results discussed here can be reproduced with the code rk4_ Re1TOV.f90 
available as Electronic Supplementary Material described in Appendix B. 


Exercise. Likewise in the Newtonian case, construct M vs po. plots for 
different values of y. This time monitor the change of the location of the 
maximum mass and the star point that indicates where the binding energy 
changes sign. 


2.11.8 The String: An Eigenvalue Problem 


An eigenvalue problem is defined by an ODE of the form Lu = lu that satisfies 
boundary conditions in the domain x € [xo, x y], with L a linear differential operator 
and / an eigenvalue. A traditional example of this type of problem is Helmholtz 
equation: 


du Pion 2 


defined on the numerical domain x € [0, 1] with Dirichlet boundary conditions 
u(0) = u(1) = 0. This problem has a general solution of the form u = A cos(kx) + 
B sin(kx), and the boundary conditions fix the constants to 

u(0) = A =0, 

u(1) = B sin(kx)|x=1 = B sin(k) = 0, (2.66) 
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which restricts the values of k to k = nz with n an integer. Notice that this problem 


can actually be cast as an eigenvalue problem with L — = and | = —k?: 
du 2 
is —k*u, (2.67) 


for which we know that the solutions are the eigenfunctions uy = B sin(kx), each 
of them associated with the eigenvalue —k? = —n?z?. 

This is a problem that will help illustrate the shooting method. So far we have 
illustrated the integration of [VPs associated ODEs, but eigenvalue problems are 
boundary value problems in which the unique solution of an ODE is determined with 
Dirichlet conditions for the solution function at two points, instead of conditions for 
the solution and its derivative at the starting point of integration. 

The strategy to solve this problem is based on the solution of the IVP for 
Eq. (2.65) starting at x = 0, using the initial condition u(0) = 0. However, in order 
for the solution to match the boundary condition u(1) = 0 at x = 1, one searches 
for values of k that fulfill such condition. 

Observe that we have solved IVPs associated to second-order equations before; 
however, we have always required initial conditions for the unknown function and 
its derivative. In this case though, the value of u’(0) is not playing any role. The 
name "shooting" suggests that one tries to hit a target with a parabolic shooting by 
choosing the appropriate derivative or inclination of a throw. 

This is not the case. What is being searched for is the value of k that allows the 
solution to fulfill the boundary conditions at x — 0 and x — 1. The derivative will 
end up playing no essential role and will control only the amplitude of the solution. 
The reason is that (2.67) 1s linear, and therefore given the solution u, the function 
au is also a solution for an arbitrary amplitude a. 

In order to solve the problem, we cast the equation as a system of two first-order 
ODEs by defining v = du/dx. In this case Eq. (2.67) can be written as 


du 
dx 
dv 
dx 


(2.68) 
a 


for ug = 0, vo free and k the important number to search for. 

In order to show how this process works, let us solve system (2.68) with vo — 0.1 
and two values of k — 2, 4 on purpose, for illustration, because we already know for 
this problem that k is multiple integer of 2, and we choose one value smaller and 
one bigger than 7r. 

We construct the solutions for the domain D — [0, 1] on the discrete domain 
Da = (xi = i Ax} fori = 0, ..., N with resolution Ax = 1/N. For the examples 
below, we use N — 100 or resolution Ax — 0.01 with the RK4 method to solve 
the IVP, and the results are shown in Fig. 2.32. In these two cases, one can see that 
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Fig. 2.32 Solution of (2.68) 
for uo = 0, vg = 0.1 and two 
values of k = 2,4 


the slope of the solution is the same for the two values of k at x = 0, but none of 
the solutions hits the target at x = 1 such that u(1) = 0. Fork = 2, u(1) > 0, 
whereas for k = 4, u(1) < O0, and this result is useful because if the transition 
between positive and negative is continuous, there would be a value of k that fulfills 
the boundary condition within a small tolerance |u(1)| < e, because it should be 
expected that the boundary condition at x — 1 can only be fulfilled with a certain 
finite accuracy. The tolerance we use for this exercise will be set to € = 1078 in 
what follows, unless specified otherwise. 

The problem now is the search of the appropriate value of k, which can be found 
using a bisection search. The value of k, using bisection works as follows (see, e.g., 


[1]: 


1. Solve the system for an initial k = ko. Let us assume ko > 0 is small so that the 
solution at x — 1 is positive. 

. Evaluate the solution at the right boundary u(1). 

. If |u(1)| < e, k is a good eigenvalue and the process can finish. 

. If u(1) > e, increase k = k + dk 

. Else, if u(1) « —e, there was a change of sign at the right boundary. 


Un 4 Wh 


— Return to the previous value of k, that is k = k — dk 
— Redefine the step dk, for example dk — dk/2 
— Restart from step 4 


6. If |u(1)| « e, k is a good eigenvalue and the process can finish. 


An example of the solution to this problem using this strategy is shown in 
Fig. 2.33 assuming ko = 0.1 and initial dk = 0.1, using v9 = 0.1 and vg = 0.5. 
The number of iterations was less than 80, and k = 3.1415924540399374 is the first 
value of k that fulfills |u(1)| < e. This plot illustrates the aforementioned role of 
the derivative at x = 0, namely, it regulates the amplitude of the solution which is 
bigger for vp = 0.5 than for vp = 0.1. 

The effect of reducing the tolerance, for example, if € = 10-12, has an 
improvement on the value of k = 3.1415926790940412 and a slight increase in 
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Fig. 2.33 Solution for 0.16 
vo = 0.1 and v, = 0.5. The 

effect of vo on the solution is 
reflected in the amplitude. In 0.12 | 
both cases the boundary 

condition is fulfilled with 
€ = 1078 after less than 80 > 0.08 | 
iterations 


the number of iterations. For a fair comparison in the accuracy of the calculation 
of x, we use the common double precision value of x in fortran 90 that we 
calculate as zr = arccos(—1.0d0) = 3.1415926535897931. The digits in bold are 
those in which the value of the eigenvalue and the value of z differ. Notice that 
the improvement is in only one digit when reducing the tolerance four orders of 
magnitude. 

Let us go further. So far we have used vo > 0, which launches initially positive 
solutions of u. If vo < O it is important to take care of the bisection process because 
the change of sign at x — 1 will happen from negative to positive. 

Nodes. Now, as indicated by the exact solution, the eigenvalue of the problem is 
k = nm, and so far we have only solved a problem for n = 1, corresponding to zero 
nodes of u. For the construction of u with nodes two elements are needed: 


(i) Count the number of zeros of the solution for each k used for the integration. 
(i) Keep increasing the value of k until the desired number of nodes is achieved 
and then execute steps 4 to 6 in the algorithm above. 


Locating the zeroes of the solution u for each value of k can be done by counting 
the changes of sign of u within the RK4 integration process, by asking whether 
ujuj-| X O at each point of the domain, taking care at the borders x9 = 0 and 
xy = 1, where we expect the solution to be near to zero. This is the reason why 
in the code below, a buffer of two points from the borders is used to make sure the 
Zeroes are in the interior of the domain. 

The code that solves this problem xk4 Helmholtz.f90, available as Elec- 
tronic Supplementary Material described in Appendix B, has the loop that controls 
the values of k and counts the number of nodes. The Part B of the code is the 
following: 


! Set initial conditions 
open(1,file-'Helmholtz.dat') 
u(t, 0) e xo ! ud 

u(2,0) = y0 ! v0 


k = k0 
| ---> PART B «--- 


2 Ordinary Differential Equations 


DO l-1,k it max ! k it max is a maximum number of throws 


zeroes = 0 
do i=1,N 
do j=1,4 
if (j.eq.1) then 


call calcrhs( t(i-1) ,u(: 


kl = rhs 
else if (j.eq.2) then 


call calcrhs( t(i-1) + 0.5d0 « dt, u(:,i-1) + 0.5d0 « k1(:) 


x dt) 
k2 - rhs 
else if (j.eq.3) then 


call calcrhs( t(i-1) + 0.5d0 « dt, u(:,i-1) + 0.5d0 * k2 «x 


dt) 
k3 = rhs 
else 
call calcrhs( t(i-1) + dt, u(:,i-1) + k3 «x dt) 
k4 = rhs 
u(:,i) = u(:,i-1) + (1.0d0/6.0d0)*( k1 + 2.0d0 * k2 + 
2.0d0 * k3 + k4 ) * dt 
end if 
end do 
! The following counts zeros 
if ( (u(1,i)*u(1,i-1).le.0.0d0) .and. (i.ge.2).and.(i.le.N-2) ) 
then 
zeroes = zeroes + 1 
end if 
end do 


|! ---» Ends Part B «--- 


! Changing k 
Xl p = u(1,N) 
print «,1-1,k,u(1,N) 


if ( (zeroes.eg.num of nodes) 
* Xl p.1t.0.0) ) then 
k - k - dk 
dk = 0.5d0 » dk 
else 
k = k + dk 
end if 


do i=0,N,2**resolution_label 


write(1,*) t(i),u(1,i),u(2,i) 


end do 
write (1,*) 
write (1,x) 

! Tolerance 


.and. ((-1)** (num_of_nodes) 


if (abs(u(1,N)).lt.epsilon) then 


exit 
end if 
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END DO 


close (1) 
print «, zeroes « acos(-1.0d0). ! Only for comparison with the 
exact solution nx«pi 


end program 


Notice the subtle control on the change of sign at x — 1. When the solution is 
passing from positive to negative and the number of nodes is even, the result is 
correct. However, when the number of nodes is odd, the solution should be passing 
from negative to positive. Of course all this is valid when vo > 0 and would be the 
opposite otherwise. 

Finally, the right-hand sides of the system (2.68) are coded as follows: 


subroutine calcrhs (my t,my u) 


use numbers 
implicit none 


real(kind-8), intent(in) :: my t 

real(kind-8), dimension(NE), intent (in) :: my u 
rhs(1) - my u(2) 

rhs(2) = -k**2 * my u(1) 


end subroutine calcrhs 


Solutions corresponding to various iterations during the solution of the problem 
for cases with 1, 2, 3, and 4 nodes are shown in Fig. 2.34. The values vo = 0.1, 
initial kọ = 0.1, and initial dk = 0.1 were used in all these solutions, in 
order to show that during the first iterations, when the value of k is growing, 
the solutions are the same from 20 to 40 iterations, and they only start differing 
when the solution acquires the appropriate number of nodes. The final values of 
k where k = 6.2831864339588037 ~ 27, k = 9.4247834656355280 ~ 3x, 
k = 12.566397281980471 ~ 47, and k = 15.708041615903994 ~ 5x, correspond 
to solutions with 1, 2, 3, and 4 nodes, respectively. 


Exercise. Later on in the book we show some exact solutions of the stationary 
Schródinger equation. Using the shooting method, solve Eq. (3.64) for the 
particle in a one-dimensional box, and show that the allowed energies are 
discrete according to Eq. (3.65). 
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Fig. 2.34 Solutions for 1, 2, 3, and 4 nodes that fulfill the boundary condition |u(1)| < € = 10-8 
for different values of k. Numeric labels near certain curves indicate the iteration number in the 
bisection loop 


2.11.9 Test Particle Orbiting a Central Object 


In this case we consider the motion of a particle of mass m subject to a central 
Newtonian gravitational field. Let us first review the elements of the central field 
problem. 

The Lagrangian of a test particle of mass m subject to a central field is 


1 
£= mi. X— V(xp. (2.69) 


where X is the velocity of the particle and the potential V depends only on the 
distance to the origin of coordinates, where the source of the field is assumed to lie. 
If this Lagrangian is considered to be written in spherical coordinates (r, 0, $), then 
V = V(r). Since £ does not depend on 4, the angular momentum £ = 8£/8$9 = 
mr?$ is a constant of motion, and because it is conserved, the trajectory of the 
particle is a curve on a plane and also leads to the second Kepler's law. That the 
motion happens on a plane is the property we exploit below. 

Even though the description of motion is usually written in polar coordinates, we 
use Cartesian coordinates to program a code. We assume the gravitational field is 
due to a point-like source of mass M located at the origin of coordinates. According 
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to second and gravitation Newton's laws, the position x of a test particle with mass 
m evolves according to the equation: 


d? M d? M 
PU NET SU ENTIRE EN (2.70) 
Ix? |x|’ 


Here we assume the test particle has mass m with the condition m « M, 
which implies that the position of the particle of mass M sourcing the dominant 
gravitational field can be considered fixed in space at the origin of coordinates. 
Given initial conditions for the position x(0) = xo and velocity x(0) = vo of the 
test particle, one has a well-posed IVP consisting of three second-order equations 
that can be decomposed into six first-order equations by defining x — (x, y, z) and 
X = (vx, Vy, Uz): 


dx 

a 

dy 

a” 

dz 

dre 

dw, GMx a 
dt — (x2 + y2 + z2)3/2 
dvy GMy 

Ze <= (x2 + y2 + 223/72 
dv; GMz 

dt (x2 + y2 + 2A 


with initial conditions x(0) = xo, y(0) = yo, z(0) = zo, Ux(O) = vxo, v, (0) = 
Vy0, Uz (0) = vzo. 

Let us study some cases of interest and review some theoretical results that will 
help to verify the numerical solution and set initial conditions. In polar coordinates, 
the trajectory of the test particle is 


x—rcosós +rsingĵ, (2.72) 


and can be parameterized with the formula 


a erry a (2.73) 


r 
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where p is the parameter and e the eccentricity of the trajectory, which are given by 


EN. zwi run 2kEP (2.74) 
= GMm?' dag G?M?m?' ` 


and E = Imi? T - = Gm is the total energy of the test particle. For elliptical 


trajectories 0 < e < 1 and in such case the parameter is given by p = a(1 — e?) 
where a is the semimajor axis of the ellipse. In this case 


1 — e? 1 — e? 
Y Ue el gatas > a e) 


r= ———————— (2.75) 
r r 1 +ecosġ 


whereas $ evolves according to the constancy of the angular momentum £: 


. £ /GMm?p | /GMa(1-— e) GM " 
pes mr mr? = r? B a*(1 yr ONES 


(2.76) 


Initial conditions xo for the position of a test particle in an elliptical trajectory can be 
defined in terms of a and e. For example, by initializing the position of the particle 
2 
at the angle ¢ = 0 and using Eq. (2.75) to determine r, one has that r = e A 
On the other hand, the initial velocity vo at @ = O is tangent to the trajectory and 
has only y—component with magnitude r$. These two conditions and the use of 


Eqs. (2.75) and (2.76) together give 


a(l- e°), 
xo = —— îŝ, 
l+e 


a(l — e?) GM Y GM n 
= 1 = | ——— (1 . (2.77 
Vo DE Bde Teyy "Eme +e). (2.77) 


Some particular examples we can use for illustration are the trajectories of some 
important objects orbiting around the Sun, whose orbital parameters needed to set 
initial conditions appear in Table 2.1. We use MKS units, consider G = 6.6743 x 


10-1! we and M = Mọ = 1.98847 x 109? kg. 


Table 2.1 Orbital parameters of the trajectories of some important objects around the Sun 


Object a(m) e e (2 

Earth 1.49598023 x 10! ! 0.0167086 0 — 11.260649 
Jupiter 7.78479 x 101! 0.0489 1.303° 100.464° 
Pluto 5.906423 x 10? 0.2488 17.16° 110.299° 


Comet Halley 2.66792 x 10!? 0.96714 162.26° 58.420 
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We construct the numerical solution using the RK4 method like in the previous 
examples on the domain t € [0, tmax] with units in seconds, discretized as Dg = 
(t; = i At}, with resolution At = 100s and tq, appropriate for each object's orbit. 

Integration of Eqs. (2.71) using initial conditions (2.77) leads to the results 
in Fig. 2.35. We show the coordinates of the objects as function of time on the 
equatorial plane, as well as the trajectory of each one on its own orbital plane. For 
comparison among the orbits, we show the four trajectories together in Fig. 2.36. 

Now considering that the orbital plane of each of these objects is not the same 
adds extra complexity to the problem, specifically to establish initial conditions. 
Assuming the reference plane is Earth's orbit plane, the inclination of the orbital 
planes of Jupiter, Pluto, and Halley's comet with respect to Earth's plane is O and 
appears in the fourth column of the Table. 

Another parameter is the orientation of the plane of each object, including 
Earth, with respect to a reference direction, because not all ellipses have the same 
orientation as assumed in the construction of Fig. 2.35. Assuming that the reference 
direction is the First Point of Aries, §2 is the orientation angle of the orbit and is 
specified for each object in the Table. 

With these two new parameters, the initial conditions need to be modified. First 
we still assume that the initial angle within the orbit is ¢ = O. Initial position and 
velocity of the test particle (2.77) need two successive rotations, one rotation Ry, © 
around the y-axis by the angle © and then a rotation Rz, around the z-axis by the 
angle £2 as follows: 


cos O 0 — sin © a(1—e) 


= I+e 
Xo = R;oRyoXo = Rz 2 0 1 0 0 
sin@ 0 cos 0 0 
cos (2 — sin (2 0 eed ©) cos 9 cos Qr ) cos O 
=] sinf2 cos2 0 0 = sin 2 40> D cos © i 
0 0 1 ae) ) sin © aq- A sin © 
cos O 0 — sin © 0 
Vo = R;oRyevo = Rz, 0 1 0 a im (1 4 e) 
sinQ 0 cos © 0 
cos (2 — sin 2 0 0 — sin 2 zie eh (1 +e) 
= | sinf2 cosQ 0 za- em (1 + €)|7| cos 2 uc aia +e) | 
0 0 1 0 0 


(2.78) 


where the bar indicates the new initial conditions of the test particle used to integrate 
Eqs. (2.71). The resulting trajectories in three dimensions appear in Fig. 2.37. 
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Fig. 2.35 On the left we show the x and y position of the three planets and the comet as function 
of time and on the right the trajectory on the z = 0 plane. Time is in years and position in meters. 
The Sun is fixed at the origin of the xy—plane. The orbit is constructed assuming that each object 
travels on its own xy—plane, whereas the initial conditions according to (2.77) for each object are 
set separately, and then what is seen are the coordinates and orbit of each object in its own orbital 


plane and all of them with the same orientation 
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Fig. 2.36 Orbits of the four 8x10"? 
objects together in order to a 
; Ulo. nn 
compare among spatial a alite 
scales. Units are in meters adt Lo N Earth — 1 
f \ 
~ of CC 
H Sd 
-4x10'? | 
-8x10'2 ] 1 i 
-8x10 — -4xt0'? 0 4x10" 8x10" 
x 
Fig. 2.37 The orbits of the Halley 
four objects together in a Pluto 
traditional Solar System Jupiter ee = 
perspective. Units are in Earth ccr 
meters 


For programming the solution of this problem, we use the alternative approach 
described for the Newton Cooling Law, because the time domain can be so large that 
it might be unpractical to define arrays with an arbitrarily big number of entries. 
Instead we integrate the equations using the RK4 method by defining only two 
time levels of the variables u for ut! and u p for u7. Before t was defined 
as an array to store the numerical domain, it is no longer an array but a double 
precision number that is being advanced in the time domain t — t + At. The code 


rk4 SunPlanets.f90 listed in Appendix B, illustrates this approach. 


Exercise. Add the orbits of the planets not considered here and complete the 
trajectories of all the planets in the Solar System. The values of © and 2 can 
be found in online data bases. 
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Exercise. Assuming that an electron and a proton obey Coulomb law, 
integrate the trajectory of the electron around the Proton of the Hydrogen 
atom that travels on a circular orbit with radius equal to the Bohr radius. 


2.11.10 Two Body Problem 


The system consists of two particles with masses m, m» and positions x; (t) and 
x2(t). The interaction between the two particles depends only on the distance 
between them |x; — xo| and on the law of interaction. A scheme with these 
conventions appears in Fig. 2.38. Assuming these particles interact gravitationally 
according to the universal gravitational law, second's Newton law establishes that 
the equations of motion of the particles are 


dX| mim» ( ) 
m = X X1), 
: dt? [x1 — x2? k i 
mpeg Pes (2.79) 
dt? [X1 — x2|? 


where the direction of the acceleration is included in the sign of (x — x2). This 
system defines an IVP in the time domain ¢ € [0, tf], associated to a six second- 
order ODEs that can be translated into a system of twelve first-order equations. 
Using the definitions xy = (x1, y1, Z1), X2 = (x2, y2, 22), Vi = X1 = (Vix, Viy, viz) 


Fig. 2.38 Scheme of the two my 
body problem X| X2 


ma 
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and v2 = X2 = (v2, v2y, V2z), the system of Eqs. (2.79) is explicitly 


dt 


dt 


dx| u 
dt 
dy _ 


dz 
dt 
dx2 
uo 
d» 


dz» 
dt — 


dv G X2 —X] 
= Uy], = Gm2 
£ dt r3 
dvyt y2- Yi 
= Vy], 2 = Gm 3 
dt r 
dv; 42721 
= Uz1, - Gm» , 
dt r3 
, dvx2 Gm 
= 2> 1 
E dt r3 
dvy2 y1— 
y 1— y2 
= Uy2, = Gm, —_,— 
dt r 
P dvz2 z|— 22 
s z2» = 1 , 
dt 3 


where r = 


87 


(2.80) 


V(x — x2)? + 1 — y2)? + (zı — z2)?. Initial conditions are 


needed for all six coordinates x19, y10, Z10, X20, Y20. 220 and six velocities 

Ux10; Uy10,Uz10.Ux20.Uy20,Uz20- 
Before we solve the problem numerically we review the theory of the problem. 
The two body problem in Fig. 2.38 has total mass M = m + m», reduced mass 


.. mym 
b= mı+m2 


and x := x, — X? is the vector between the position of the two particles. 


Being X, the center of mass, in the reference system located at the center of mass, 


we have 


Xem = MX, d mox2-20 => 


m(x+x2)+m2x.=0 > 


(mı +m2)x2+mx=0 > 


x2 = 


Xj =X+X = 


X] = 


(2.81) 


that is, the position x; and x» of the two particles appears in terms of x. Since gravity 
is a central field, the Lagrangian of the system becomes 


L= 


1 1 
jn -X1 + ja. : Xo — V (|x) 


1 
-uX-X— V(|xp. 
gie (|x!) 


(2.82) 
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This is the Lagrangian of a virtual particle of mass u, whose position is x, subject 
to a central potential V. If the space is described in cylindrical coordinates (r, $, z) 
with basis vectors (7, $, 2) then 
x=rf+z? > 
ž=+}°+rġĝ +}? > 
x= 747797 +2. (2.83) 


The expression (2.83) and the fact that |x| = ~r? + z? imply that the Lagrangian 
(2.82) is independent of $, which in turn implies that the angular momentum along Z 


JL 2 iri 
E = iE 2.84 
a $ (2.84) 


is a constant of motion. Therefore, like in the Lagrangian of a test particle around 
a central field (2.69), the motion of this virtual particle of mass jz subject to the 
potential V (|x|) occurs on a plane that we choose to be the equatorial plane at z = 0 
and consequently z = 0. With this conventions, the energy of the system is written as 


1 
E = -px-x+ V(r) 


2 
1 ., 4 m\m2 
= pit + Dart i (2.85) 


The trajectory of this particle can be described with the position vector in the 
Cartesian basis but cylindrical coordinates 


x—rcosóx +rsingĵ, (2.86) 
and once x is known, the position in time of each of the two particles can be 


calculated using (2.81). The trajectory of the virtual particle can be written in 
parametric form according to Eqs. (2.74)-(2.75): 


P =1+ecos¢, Q.87) 
: 


where p is the parameter and e is the eccentricity of the orbit, which in terms of the 
angular momentum (2.84) and energy (2.85) of the system read 


g 
zL————, 2.88 
p DINE (2.88) 
2bEUC 
e= |l + ———. (2.89) 


22 m2 
nu G^mqm 
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From now on we consider only the case of elliptical trajectories, that is, 0 < e < 1. 
In this case p = a(1 — e?) where a is the semimajor axis of the elliptical trajectory. 
From the parametric Eq. (2.87), one has r = p/(1 + ecos $), which implies that 


32 
„40-69 (2.90) 
l4 ecosó 


With this result one can construct the equation of motion for ¢ as follows: 


des £ m Jf Lu Gm,m»p 
ur? p 


|. V Gmimoa(1— €) _ / GMa(1— e?) 


/ 2 
mim» 2 r 
-M T 


| GM 
- Sai" +ecos¢)’. (2.91) 


Given a and e one obtains ¢ integrating (2.91) in time, and then calculate r using 
(2.90), and it is possible to calculate the position x using (2.86). Finally the position 
of each particle using (2.81): 


m2 cos oh + sings) ma(1 — e?) cosg + sings], (2.92) 
Xj = — r (cos sin = ———_[cos sin ; 
IM. T * M(1+ecos¢) one Hs 
mja(1 — e?) 


x = -T r Cos pî + sings) = [cos p£ + sin $ y]. (2.93) 


~ M( +ecos¢) 


We use these results to set initial conditions for the evolution of two gravitationally 
interacting point particles. We choose the value of the angle @ = 0 at t = 0, and 
then using (2.92) and (2.93), we calculate the initial positions of the particles: 


moa(1- e), 
——————X 


X10 = M , 

mja(1-— e), 
X20 = ———————á. 2.94 
2.0 M x (2.94) 


The initial velocity is constructed using the tangent velocity, which has only 
y—component, and we use (2.91) to define the initial angular velocity: 


: G(m, + m) 
do = pa m lt? (2.95) 
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Fig. 2.39 Trajectories of the Sun-Jupiter two-body system. On the left the trajectories of the two 
objects. On the right a zoom of the Sun’s trajectory 


thus, the initial velocity of each particles is 


ma(l—e). , 


v1,0 = ~u poy, 
mia(l—e). , 
= —— : 2.96 
V2.0 M poy (2.96) 


These initial conditions are used to explore the numerical solution in a couple of 
scenarios. 

Sun-Jupiter case. We solve the problem considering the solar mass Mọ = 
1.98847 x 10?? kg and Jupiter's mass My = 1.8982 x 107" kg. Using these values, 
together with a and e from Table 2.1 for Jupiter, we integrate equations (2.80) and 
the results are shown in Fig. 2.39. 

First, notice that the center of mass is at the origin of coordinates as defined in 
(2.81). The trajectory of Jupiter is pretty much that of Fig. 2.35, however differences 
in the trajectory appear with a zoom because now the planet orbits around the center 
of mass, not around the Sun. 

The zoom of the Sun's trajectory in the Figure reveals that the Sun orbits around 
the center of mass on a finite size trajectory. In the previous section, the Sun was 
assumed to be so dominant that it would occupy the position of the center of mass; 
however, when the two bodies interact, this is no longer the case. Consider that the 
solar radius is Ro = 6.957 x 10? m and thus the orbit of the Sun around the center 
of mass has size of the order of its radius. 

The case of GW150914. We can simulate the Newtonian version of the trajectory 
of the two black holes first detected as source of Gravitational Waves. The mean 
parameters inferred from the observations are the black hole masses m; = 36Mo 
and m2 = 29 Mo, estimated assuming eccentricity e = 0. The trajectory is in reality 
not elliptical, and initial conditions need to be set in order to fit the Gravitational 
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Fig. 2.40 On the left the coordinates of the hole with mass m, as function of time. On the right the 
trajectory of the two holes on the xy— plane. Notice that since e = 0, the trajectories are circular. 
Units are in meters and seconds 


Wave strain. We here assume that initially the holes are in orbit with a = 6.1 x 
10? m. 

Using these parameters we integrate equations (2.80), and the results appear in 
Fig. 2.40. These would be the trajectories of the black holes if the process would not 
emit gravitational radiation and both, energy and angular momentum, are conserved, 
unlike in the case with emission of gravitational waves, which carry energy and 
angular momentum outwards, leading to the eventual merger of the two holes. 
Modeling the loss of angular momentum and energy can only be done in the general 
relativistic regime by solving Einstein equations for two black holes (see, e.g., [10]). 

The results discussed here can be reproduced with the code 


rk4 TwoBodies.f90 available as Electronic Supplementary Material described 
in Appendix B. 


Exercise. Compare the time series of x(t) of Jupiter’s orbit with that obtained 


in the previous section and determine the shift of the orbit along the x-axis in 
meters. 


2.12 How to Improve the Methods in This Chapter 


The methods developed and used in the applications are very simple and yet very 
useful in a wide number of scenarios. Other problems might need specific methods 
due to the stiffness of the equations or can depend on the conservation of a specific 
functional, like energy, where dissipation becomes important. 
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The few methods described and used here are limited by their stability and 
dissipation. Stability limits the resolution and can be improved using implicit 
methods. Dissipation is extremely important in problems that need a very accurate 
conservation of energy, and the methods here can be replaced by symplectic 
methods. 

Yet, the methods here can improve importantly. One possibility involves the 
adaptive step size that can be easily implemented within the codes learned here and 
are well described in [11]. Another straightforward possibility is the implementation 
of higher-order Runge-Kutta methods. 


2.13 Projects 


With the methods described in this chapter, it is possible to carry out the following 
projects. 


2.13.1 Synchronization of Chaos and Message Encryption 


An exciting project involves the synchronization of Chaos and the transmission of 
messages hidden within signals that are solution of the Lorenz system. Needless 
to mention that the project is inspired in the set 9.6 of exercises in [3]. The 
idea was implemented by Kevin Cuomo and Alan Oppenheim and is based on 
synchronization of Chaos. Consider the Lorenz system with parameters in the 
chaotic regime, as done for the construction of Fig. 2.21. Despite the irregularity of 
the signal, it is possible to construct a second system similar to the Lorenz system, 
whose solution approaches the solution of the original one. The process is called 
synchronization in the chaotic regime. Assume we solve the Lorenz system that we 
call emitter, rewritten with a different set of tag variables u, v, w: 


ù = a(v — u), 
ù = bu — v — uw, 


Ww = uv — cw. (2.97) 


Once the solution is calculated, one constructs a similar system called receiver: 


uy = a(v, — u(t)), 
v, = bu(t) — v, — u(t)w, 


w, = u(t)vy — Cwr, (2.98) 
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Fig. 2.41 On the left we show the time series of u showing the system is in the chaotic regime. On 
the right u — u,, v — v,, w — w, as functions of time that illustrate the process of synchronization, 
because the differences between the variables of emitter and receiver become indistinguishable 
after a finite time. The parameters used are a = 10, b = 28, c = 3, with initial conditions ug = 
7, vo = 6, wo = 5 for the emitter, whereas initial conditions for the receiver are arbitrarily uo = 
3ug + 10, v;o = 2v9 — 4, w,o = Two + 15 


whose essential property is that u(t) is the solution of the emitter system (2.97). 
It can happen that with the pass of time, the solution u;, vp, w, tends toward the 
solution u, v, w. When this happens it is said that the emitter and receiver have 
synchronized. 

Synchronization occurs even when initial conditions are different for the two 
systems. In Fig. 2.41 we show an example of synchronization of the Lorenz system 
and the differences between emitter and receiver variables, that is, u — u,, v — 
Ur, w — wy, as functions of time. Notice that the differences approach zero rapidly. 
The synchronization happens for a set of rather different initial conditions for the 
emitter and the receiver. 


Sending a Message. The emitter can superpose a message m (t) to the chaotic signal 
u(t) that we choose to be a harmonic function modulated by a Gaussian that we 
arbitrarily center at time t ~ 100: 


u(t) > u(t)+m(t), mA) = Asin(er)e 6-109. 


Thanks to synchronization, the receiver will calculate u,, v, w, that we know tend 
toward u, v, w, and therefore the message can be subtracted from the receiver 
solution u»: 


m,(t) = u(t) — uy. (2.99) 


In Fig.2.42 we show the emitted and received signals for messages using two 
different frequencies. It is unfortunate that the error in the quality of the recovered 
signal depends on the frequency of the signal used to send a message. But it has 
an explanation. It happens that the Fourier Transform of the solution in Fig. 2.41 
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Fig. 2.42 Examples of message, both original and recovered for low œ = 10 and high w = 80 
frequencies. The resolution used for the solution of the equations is At = 4 x 1075 


Fig. 2.43 Fourier Transform 
of the solution of Fig. 2.41. 
Notice that the power is 
smaller for higher 
frequencies. Then a message 
can be recovered more 
accurately if it is transmitted 
using high frequencies, 
bigger than 60 for example 


has strong power for small frequencies as we show in Fig. 2.43. It happens that the 
message with small frequencies can be confused more easily when transmitted in 
small frequencies than when using high frequencies as found in [12]. 

One project can include the measurement of fidelity message recovery as 
function of frequency and amplitude of the message. Plots of Lı and L2 norms 
of the error e = m(t) — m, (t) would reveal the desired dependency. 

The project can include the transmission of more elaborate messages, not only 
those modulated with a Gaussian centered at time t = 100. For example, the super- 
position of modulated harmonic functions m(t) = X, = Ax sin(wet) exp(—(t — 
i m with different amplitudes, frequencies, and modulation pulses. 


2.13.2 Gravitational Waves Emitted By a Binary System Using 
the Quadrupolar Formula 


Detected Gravitational Waves are sourced by binary systems of compact objects, 
either black holes, neutron stars or a combination of the two. The process of 
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merger, horizon growth, and production of Gravitational Waves is calculated by 
solving Einstein's field equations, an elaborate system of nonlinear coupled PDEs. 
Nevertheless, in the orbital phase prior to merger, post-Newtonian and quadrupolar 
formulas explain well the strain of signals. 

In the Newtonian regime, the problem can be defined using the notation of the 
two body problem illustrated in Fig. 2.38. When the system emits Gravitational 
Waves, energy and angular momentum are radiated away, and consequently the 
trajectory of the particles is strongly modified, the semimajor axis a, eccentricity 
e, angular momentum £, and period P of the orbit change in time. The system 
of equations that model the evolution of the time average on a period P of these 
quantities can be found in [8] and [13]: 


64G? uM? Dare), 


1 
5580-2 *34" 7-95 


304G? uM? 121 4 
+ e 
15 c? a*(1— e2)572 , 


(e) = 


32G* pM? 73 3 37,4 

E) = 1 ; 

lU e siut 24° t e) 

i 1927 G?/? M3? 73 37 

pas - gue a. 
S c ad/2(1 — e2)7/2 24 96 


(i) = 


32G? jee 7 
E ( i) , (2.100) 


5 c aq!?(1—e2? 


where u and M are the reduced and total masses of the binary system and G, c are 
the fundamental constants. Suitable initial conditions are that the semimajor axis 
and eccentricity have some values a and eo and that the energy is that of the virtual 
particle of mass u on a circular trajectory at initial time, and consistent initial value 
of the period and angular momentum for ao and eo are as follows: 


a(0) — ao, 
e(0) = eo, 

1GuM 
E@)=-~—, 

2 ao 

2x 3/2 
P(0O) = ay > 

VGM ° 

£(0) = V Gao — eg) pM. (2.101) 


Notice that for the case of two point particles, the parameters ao and eo determine 
the initial conditions for all other variables. In order to know the trajectory of the 
virtual particle, one has to couple the equation of the trajectory (2.91) assuming the 
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parameters of the orbit are those integrated from the system (2.100) as averaged 
over one orbital period P: 


= CM 14 (e) cos)? (2.102) 
P= acus © tmm» | 


From this, using (2.92) and (2.93) one can track the location of each particle. On 
the other hand, the strain of the Gravitational Waves radiated has two polarizations 
with the time dependent parameters of the orbit, following [8]: 


hy = —(2.2)° - cos(2tw(t)), (2.103) 
2 4uM . 
hx = (2.2) (aj R sin(2ta(t)), (2.104) 


where w = N and R is the distance from the binary source to the Earth. The time 
domain is restricted by the time it takes for the two particles to collide, the so-called 
collision time that reads [13]: 


5 ,A4 
5 c ag 


2 E 2.105 
256 G3 uM? (2.109) 


teoll = 


so that t € [0, tco]. The solution of Eqs. (2.100) in this time domain can lead to 
gravitational wave signals similar to those in observations. 

The case of GW 150914. In this case the parameters of the binary source inferred 
from the first observation of Gravitational Waves [14] are the masses of the black 
holes my = 3613 Mo, m = 29 4 Mo, and the distance to the source R = 


410* 180 x 10°pe. Assuming an initial separation of ay = 610km, one can obtain a 
minimum number of cycles of the strain as in the observation. The time for collision 
in this case is teoll = 0.13383 00s. One can explore the case with or without 
eccentricity. 

For example, the case eo = 0 leads to the strain and trajectory of the two black 
holes as illustrated in Figures 4.5 to 4.7 of [15]. The strains h+ and hx are integrated 
for combinations of mı and m» and various values of the distance to the source R. 
Similar signals can be obtained for the various other combinations of mı and m» 
within the uncertainties reported in [14]. 

The project consists in producing a catalog of strain signals that might serve for 
comparison with observations in the interferometers of Gravitational Waves. 
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Chapter 3 M) 
Simple Methods for Initial Value gai 
Problems Involving PDEs 


Abstract In this chapter we implement the simplest methods used to solve Initial 
Value Problems associated to Partial Differential Equations, restricted to the case 
of one spatial and one temporal dimensions. We start by defining the problem on 
a discrete domain of finite size for a general problem and show how to construct a 
discrete version of the problem. To our view, the wave equation is the simplest and 
most illustrative equation, the reason why we use it to describe the implementation 
of the Finite Differences method in the construction of a global solution on a finite 
domain, of initial conditions, as well as various types of boundary conditions. 
We also use this problem to illustrate the stability of evolution schemes and the 
construction of the Crank-Nicolson implicit method, whose most important property 
is stability. We take advantage of this discussion to exemplify the stability of simple 
and implicit schemes in the solution of the Diffusion equation. We finish the chapter 
with the solution of Schrödinger equation. In this chapter, the specific IVPs studied 
are the paradigms of hyperbolic, parabolic, and complex equations. 


Keywords Partial differential equations - Basic methods - Wave equation - 
Schrödinger equation - Diffusion equation - Error theory - Convergence 


In this chapter we implement the simplest methods used to solve Initial Value 
Problems associated to Partial Differential Equations, restricted to the case of one 
spatial and one temporal dimensions. We start by defining the problem on a discrete 
domain of finite size for a general problem and show how to construct a discrete 
version of the problem. To our view, the wave equation is the simplest and most 
illustrative equation, the reason why we use it to describe the implementation of the 
Finite Differences method in the construction of a global solution on a finite domain, 
of initial conditions, as well as various types of boundary conditions. We also use 
this problem to illustrate the stability of evolution schemes and the construction of 
the Crank-Nicolson implicit method, whose most important property is stability. We 
take advantage of this discussion to exemplify the stability of simple and implicit 
schemes in the solution of the Diffusion equation. We finish the chapter with the 


© The Author(s), under exclusive license to Springer Nature Switzerland AG 2023 99 
F. S. Guzman, Numerical Methods for Initial Value Problems in Physics, 
https://doi.org/10.1007/978-3-031-33556-3 3 


100 3 Simple Methods for Initial Value Problems Involving PDEs 


solution of Schródinger equation. In this chapter, the specific IVPs studied are the 
paradigms of hyperbolic, parabolic, and complex equations. 


3.1 Discretization of an IVP 


Consider the IVP associated to a sufficiently general second-order PDE defined on 
a two-dimensional domain, being ft and x the independent variables that label time 
and space: 


combination of ( , j a A P) —g(x,t) f-fQ.t 

D = x € [Xmin, Xmax] X t € [0, tf] Domain 

f(x, 0) = fo(x) Initial Conditions 
f(x, 0) = for) 

f Ginins t), f(Xmax, t) Boundary Conditions 


(3.1) 


It is possible to construct an approximate solution of this problem on a discrete 
domain using a Finite Differences approach. Two ingredients are needed: 


1. Define a discrete version of the domain Dy. 
2. Construct a discrete version of the PDE, together with an evolution scheme across 
time labels, as well as of initial and boundary conditions. 


1. The discrete domain Dg. A simple discrete domain is the set of points Dg = 
(Gi, 1*)), where x; = Xmin + iAx with i = 0,..., Nx and t^ = nAt, Ax = 
(Xmax — Xmin)/ Nx, At = tf /N;, are spatial and time resolutions. Notice that the 
domain is defined in a very similar way as done for ODEs. Again N, is the number 
of cells of size Ax that cover the domain along the spatial direction, or equivalently 
there are 2N, + 1 points at all times that define D4. An illustration of Dg is shown 
in Fig. 3.1, where particular points of the domain are indicated. 

The key importance of this domain is that the functions involved on the IVP 
are defined at points of Dg only. This means that f and g are functions evaluated 
at points of Dg, explicitly f = f(xi,t") and g = (xj, t”). For ease, without 
confusion, for a generic function f we denote f(x;,t") = f7'. 

2. Discrete version of the PDE. One needs to construct a discrete version of the 
equation on the discrete domain Dg, which includes the spatial and time derivatives 
of f in the PDE of problem (3.1). We construct now the discrete version of first- and 
second-order derivatives of f that will be needed in the examples of this chapter. 


Spatial Derivatives 

Consider the grid function f; defined at each point of Dg. The construction of 
partial derivatives uses Taylor expansions of f; at near neighbors of (x;, t”). The 
values of the function f at nearest neighbors of Dg along the line t” = constant are 


fi and HEE In terms of Taylor series expansions around (x;, t”) these values are 
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Fig. 3.1 Illustration of the numerical domain Dg 
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+ OCAx^), 


+ OCAx^). (3.2) 


Appropriate combinations of these three expansions isolate the first and second- 


order derivatives with respect to x. 


For the first-order derivative, there are various suitable combinations: 


a 
fia f = ge + O(Ax?) 
Ox (xj,t”) 
a n 
of aces + O(Ax), 
Ox "c Ax 
a 
fr- fisa] — road) 
dx Gi t") 
n | fn 
x HD a eU 
Ox (x.t) A 
à 
fud 2Ax ot + O(Ax)) 
Ox (x; t?) 


(3.3) 


(3.4) 
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Fig. 3.2 Illustration of formulas (3.3), (3.4) and (3.5). The curve is supposed to represent the 
continuous f(x) and f; = f (xi) for an arbitrary time label n 


9 n ¢n 
af LISEBL T O(Ax?), (3.5) 
Ox (x;,t”) 2Ax 


which are three discrete versions of the first-order derivative with respect to x 
defined at the interior points of Dg. The first two formulas are first-order accurate, 
whereas the third one is second-order accurate. Their respective names are forward, 
backward, and centered stencils, or simply discrete versions of the first-order 
derivative. Illustration of these formulas appears in Fig. 3.2. 

These are three expressions that suffice to accurately solve many interesting 
problems. Nevertheless we want to go slightly further and construct forward and 
backward second-order accurate operators because they will be needed and, most 
importantly, to illustrate and reinforce the process of construction of these operators. 
For this, it is necessary to Taylor expand the values of f at the second nearest 
neighbors that should accompany expansions (3.2): 


m.-gemad 4| — Q Paras 
iib OX lea, 21 OX [goes 
JA 
EL LT + O(Ax^, 
3! Ox (xj t?) 
of 
n — " L2A Ly. 
fige “ax Qut?) 
22 Ax? a? 23 Ax? 9? 
zm + = + O(Ax’). (3.6) 
2! Ox (x;,t”) 3! Ox (xj,t”) 


Combinations of expansions (3.2) and (3.6) for forward and backward versions of 
the first-order spatial derivative are 


a 
fia- 4 ff + 3h = ~2ax + O(Ax?) 


X 


Gi t") 
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Em —A4fh + 3f” 


à 
tl = ET + OCAx^), (3.7) 
Ox (x;,t”) 2Ax 
n Á n R _ of 3 
fi-a — 4fi-1 + 3 ff) = 2Ax + O(Ax3) 
X Lgs?) 
a paf o A 
- "fra Mit A; (3.8) 
Ox (xj t?) 2Ax 


which are second-order accurate. 
Now we construct expressions for the second-order derivative with respect to x 
using combinations of (3.2): 


3? f 


fii 2f + fii = Ax +0(Ax4) > 
X^ Log) 
a? f Im t Siia 2 
4.2 = + O(Ax^), 3.9 
0x? (x;,t”) Ax? ( » ) ( ) 


which is a discrete centered version of the second derivative with respect to x 
defined at interior points of Dg. Like for first-order derivatives, it is possible 
to construct second-order accurate formulas for second-order derivatives of type 
forward/backward stencils using only points on one side from the point (xj, t”). 
These formulas are 


32 EN r + 4 n ae, 5 n + 2 n 

i -fis - fra tH + O(Ax’), (3.10) 
Git") 

32 — fn +4 n sn I n 

= a se 5 Fat? gary. — (Gan 

X (xj, t?) X 


Exercise. Demonstrate these two formulas using the appropriate combina- 
tions of Taylor series expansions. 


Summarizing, the approximate expressions (3.5), (3.7), (3.8) for first-order 
derivatives and (3.9), (3.10), (3.11) for second-order derivatives constitute a kit that 
will be very useful to solve the forthcoming problems. 


Time Derivatives 

The construction of discrete versions of time derivatives is pretty similar to that of 
spatial derivatives. In this case we use Taylor expansions of f at neighboring points 
of (xi, t") along the line of x; — constant as follows: 
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pfr 24:97 + Sng n + O(Ar?) 
i i ðt len — 2! BE? lan 3L IP La, any i 
B af At 3? f At gy 
Ds I f” At —— NT XE TIT + O(t’), 
üt, 24 9€ ee my 3L 9P oa 
fis fr (3.12) 
" a At? 9? AD 9? 
gp" n y Ar9f fo Qe + O(Ar*), 
Ot (x;,t”) 2! Ot (x;,t”) 3! Ot (x;,t”) 
n à 27 At? a? LAL 9? 
ge 24r! zan zae + O(Ar?). 
Ot |e DY Ot” ss 3E. «i ios 


With these expansions one can construct the following set of expressions for the 
first-order time derivative of /: 


0 
9t [Gi qn) 
3 n+l — fr 
of ee ees + O(At), (3.13) 
ot (x.t?) At 
0 
ff-fi'= A d OCA) 
Ot (xj t) 
af f m qu 
sa =“! (Art, 3.14 
BF lass Ar + ÓO(At) (3.14) 
D) 
Aann 24L + O(AP) 
(xj t?) 
9 nl | gn-l 
af) FF Loan, (3.15) 
ot (x;,") 2At 
à 
f"? -4qm 437 = -24r + O(t) 
Ot Gi t") 
af fit? Aft 4 ape ri 
oe = A wl 
=> re ET -- O(At^), (3.16) 
n-2 . n-l n. of 3 
f 4f; T3ff —2At + Ó(At) 
9t [Gig 
— = O(At^). 3.17 
ot (x.t?) 2At PAANI ( ) 


Most of these expressions will be very useful in various of the examples presented 
later on. 
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Finally, an appropriate combination of expressions (3.12) leads to a formula for 
the second-order time derivative: 


32 
pe = 2f” + p - Api + O(At^) — 
Ot” Iu qn) 
92 n-l —2 ng nl 
"Ei - zi Fi LO(AD), (3.18) 
i,t”) 


that will be useful as well. 


Error Theory and Convergence 
As before, the analysis concentrates in the analysis of truncation errors due to 
numerical methods. The error analysis of the numerical solutions of IVPs associated 
to PDEs is very similar to the theory presented in Sect. 2.7 for ODEs. The key is 
that convergence has to be satisfied at each point of the two-dimensional numerical 
domain D4. This means that at every time t” the solution should converge to the 
continuous solution, and the solution along the time direction should converge for 
each x; as well. 

We define the error of the numerical solution f; of an IVP in our two- 
dimensional domain, at each point (xj, t") by 

e = jf = T (3.19) 

where f°? is the exact solution at the point (x;, t”) in the continuous domain. 
Since convergence tests need the calculation of numerical solutions in domains 
with different resolutions, it is important to set a hierarchy of numerical domains 
Di; for such purpose, because one needs to make sure that the numerical solutions 
calculated with different resolutions are compared at the same position and time. 

A practical recipe based on that used for the solution of ODEs is described next: 


— Calculate a first numerical solution f in using the numerical domain D}, 
discretized using N, cells or equivalently N, + 1 points, spatial and time 
resolutions Ax; and Aft; = CAx,, where C is a constant Courant-Friedrichs- 
Lewy factor. 

— Calculate a second numerical solution f^? on a new numerical domain Ine using 
2N, cells or 2N, + 1 points, with space and time resolutions Ax2 = Ax, /2 and 
At» = Atj/2. 

— Calculate a third numerical solution f? ; on a third numerical domain D? defined 
with 22N, cells or 22N, + 1 points, with space and time resolutions Ax3 = 
Ax?/2 = Ax1/2? and At = Atp/2 = Ar /2?. 


2n 
i 


Notice that the N, + 1 points of D are a subset of the 2N, + 1 points of D and 
that these two are subsets of the 2?N, + 1 points of ps. Then numerical solutions 


1n, f?" and f?" can be compared at points of the coarsest numerical domain D}. 
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In practice, comparison of solutions on D J needs the downsampling of the output 
in space and time of solutions in domains D}, m > 1. For this, it is useful to define 
an integer parameter m that in the code is called resolution label as we did 
for ODEs. This parameter will help as follows: 


— Given D s is constructed with N, cells, more refined numerical domains D^! can 
be defined using 2"! N, cells along the spatial direction. 

— Since time resolution will reduce the time step to At, / 2—1 the number of time 
steps for the evolution has to be increased by a factor 2", in order to cover the 
time domain [0, tf]. 

— Then the parameter m will help to output data every 2" iterations and every 
27-1 points. 


The theory of convergence is practically the same as for ODEs in Sect. 2.7. The 
reason is that we assume At = C Ax, that is, the time resolution is proportional 
to the space resolution. This assumption will hold for various of the problems 
below, not for all of them, in which we describe the appropriate modifications. 
Then if the error in the approximation of the equation of a PDE is of order k, for 
instance, an equation approximated with second-order accurate versions of first- 
order derivatives (3.5), (3.7), (3.8), the PDE will be approximated with an error 
of order O(At?, Ax?) which is equivalent to O(Ax?) since At = C Ax. Then 
numerical solutions at time t”, m, f an and f is can be written as 


14 2 Je + EAx*, 


A k 
i-re. 


3n en Ax * 
DrequgREDT s: (3.20) 
where f em is the exact solution. If the exact solution is known, the numerical solu- 
tion converges to the exact solution at point (x;, t”) if the following convergence 
factor fulfills the relation: 


ln en k 
Eau" AX 


E E hi" 621) 
l l E 


CF: 


at time t”. Analogously, if the exact solution is unknown, one can define self- 
convergence. Specifically, the numerical solution self-converges at point (xj, t") 
if the following relation between numerical solution holds 


1 2 k A3 —d 
Ier aaa inb: 


= = 2k (3.22) 


SCF := ~ 
POAT GG a 
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where SFC of the self-convergence factor. 

Convergence and self-convergence have to be verified at each point of D4. If one 
wants to verify convergence at a given time ft”, one has to verify relations (3.21) 
or (3.22) for all i. If one wants to verify these relations on the whole Dg, it would 
be necessary to verify these relations at every time t" for all n, which is difficult due 
to the possibly great number of time slices n of Dg. Instead, calculating a norm of 
the error at time t” allows an easy presentation of the error analysis. 

The formal analysis of the convergence of the error of the norm is associated to 
the Lax Theorem, whose construction and foundations can be followed in reference 
[1]. Commonly used norms are the £; and £2, which for a function w defined along 
the continuous spatial coordinate x read 


fave n age 


min 


Xmax 
Lo(w) = / wdx . 
xX 


min 


Since in our case the domain is discrete, it is necessary to evaluate the integrals 
accordingly. The trapezoidal rule for the integral of a function w; defined along the 


discrete spatial domain with points x; = Xmin + i Ax, i = 0,..., Ny reads 
Xmax Nx 1 2 
dx — — (wi ;)A O(Ax^), 3.23 
i, wdx = > 5(wi-1 wi) Ax + OCA) (3.23) 


Xmi. . 
min i=l 


which is nothing but the sum of the area of rectangles of base Ax and height equal 
to the average of the value of w at two neighboring points. Then finally, using this 
method of integration, the discrete expressions Lı and L2 of norms £; and £2 of 
the error (3.19) are 


N. 
x 1 
Lie") =>} 5 Cedo efl) Ax 


i=1 


(3.24) 


N. 
A1 
C ASSET te As 
i-l 


These scalar functions serve to monitor the error in time. 
With these concepts it will be easy to construct convergence tests for the 
numerical solutions of IVPs that will be tackled next. 
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3.2 1+1 Wave Equation: The Paradigm of Hyperbolic 
Equations 


We use the wave equation to illustrate the solution of an IVP associated to a PDE 
using the Finite Differences approach. The 1 + 1 name is inherited from Relativity, 
where space and time coordinates are usually distinguished. The IVP for the 1 + 1 
wave equation can be defined as 


ah ao 

———-0 E d 

à ax? P= 00!) 

D = x € [Xmin, Xmax] X t € [0, tf] Domain 

$ (x, 0) = po (x) Initial Conditions (3.25) 
(x, 0) = Gola) 

$(Xmin, t), (Xmax, t) Boundary Conditions 


1. We define D, as the set of points ((x;, t”)} such that x; = Xmin + i Ax where 
i —0,..., Nx, Ax = (Xmax — Xmin)/ Nx and t" = nAt with At = C Ax. 

2. The discrete version of the PDE is constructed using expressions (3.9) and (3.18) 
together 


ép = 267 FONT di. = tor 


p" 22 Hl — O(AD, Ax?). (3.26) 
X 


= 


From this relation it is possible to solve for $7 


n+1 At n n n n n-1 2 2 
Paan A) Lo — 267 - à? ,1--26? — 4 + O(AxX?, A). (327) 


With this expression one can calculate the value of the wave function at point 
x; and time 1"*! in terms of the values of $ at previous times t”~!, t”. By 
using (3.27) for all i one has the solution of the wave function at time pel 
that is, one can construct the values of the wave function at future times in terms 
of its values in the past. 


The Courant-Friedrichs-Lewy factor C = At/Ax. In practice, for the discretiza- 
tion we first define the spatial resolution Ax, then provide a value for C, and then 
define the time resolution At = CAx. Fixing C allows to study the stability of 
evolution schemes like that in (3.27) and practice convergence tests. 

The scheme (3.27) is sometimes represented by a molecule, like that in Fig. 3.3, 
where dots correspond to points in Dg and white dots represent positions where the 
function $ is known and the black dots the position where $ is unknown. 
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Fig. 3.3 Molecule associated (ai, pr 
to the evolution scheme 
(3.27) for the construction of e 


the solution at time t”+! in 
terms of data at times t” y 
1"—!, Black dots correspond 
2. 7 i^) (x t5) (x 5) 
to positions where the values (zi-1, Wis Tirl 
of @ are unknown, whereas —9 p 9 
white dots to positions where 
it is assumed to be known 


A 


Gs = 


(xi, t^) 


How to code this scheme. For the solution of the PDE, there is no need to define 
oy as a two-dimensional array of size Ny x N;. Instead, it suffices to define three 
one-dimensional arrays for the wave function, associated to the three time levels 
involved in (3.27): 


phi, contains the entries of ar i —0,..., Ny, 
phi p, contains the entries of oy i —0,..., Ny, 

í : . zs 
phi pp, contains the entries of p; jÉ0,.....N 


The names _p and pp are inspired by the standards of the Cactus code [2]. These 
arrays can be recycled after using (3.27) for a given time label n by reassigning the 
values in their entries 


p > oF, 


p+ f 


and then release the memory assigned to the array phi associated to et The 


evolution loop in a program looks as follows: 
do k=1,Nt 


print «, k,t ! Send some info to the screen 
t = t + dt ! Evolve the label of time 


! Recycle variables 
phi_pp = phi_p 
phi_p = phi 


! Use eq (2.27) 
do i=1,Nx-1 
phi(i) = CFL**2 x (phi p(i«1) - 2.0d0 * phi p(i) + phi p(i-1)) 


+ 2.0d0 * phi p(i) - phi pp(i) 
end do 
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! «Apply some boundary conditions 


! Save data 
end do 


Unfortunately expression (3.27) works fine only for points that are not at the 
boundary of Dg. At initial time, for the calculation of ol, the scheme (3.27) needs 
the information of $; |, which is not defined within Dg; see Fig. 3.1. Analogously, 
at the spatial boundaries (xo, t) and (xy,, t), for the calculation of po *! and ex. 
values of à" , and oN, 41 are required and not defined. 

These are situations common to IVPs associated to PDEs, and we now explain 
their solution for this particular discretization of the wave equation. 

Problem at initial time. In the present case, initial conditions are specified by 
(x, 0) and d(x, 0) because the wave equation is second order in time. Formally 
these are Cauchy boundary conditions applied to the wave function at the initial 
time side of the domain (x, 0) (see Fig.3.1). There is a universe of interesting 
Cauchy initial time boundary conditions for this equation, and for illustration we 
will choose the time-symmetric initial conditions which set A(x, 0) = olx) =0 
and $(x,0) = do(x). This condition reflects the fact that the evolution has a 
symmetry between past and future at t = 0, an appealing case as we will see. 

Setting initial conditions for oe = oxi, P = $o(xi, 0) is straightforward 
because one only needs to prescribe a profile for $o(x) and fill in the corresponding 
array with values. However the time derivative in the discrete domain has to be 
declared in terms of values of the wave function in at least two time levels according 
to (3.27). For this we define a virtual time slice t~! and associate values for the wave 
function $;- ! there. The implementation is straightforward by associating phi p 
with o? and phi pp with $; l| after which it is possible to use (3.27) to start the 
evolution. 

For the initial wave function profile, we use a Gaussian $o(x) = Ae-*! o? which 
on Dg reads 


p? = Aetio. (3.28) 


The wave function at the virtual past time t~! is obtained by Taylor expanding the 
wave function backward in time $;! = o? — Ato; (99) + At 9, (G9) + O(At3). 
By assuming time-symmetry d(x, 0) = dox) = 0, which on Dg reads 0; (¢?)=0, 
which leads to the third order accurate formula: 


2 2 
6! =o + uD + OCA?) = oP + asd +r), — 6.29) 


where the last equality uses the wave equation to switch time by space derivative, 
which we can calculate using the discrete formulas (3.9), (3.10), and (3.11) on o? 
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and substituting into (3.29). Finally, start the evolution of the wave function with 
Eq. (3.27) starting with the initial values (3.28) for phi p and (3.29) for phi pp. 

Problem at left and right boundaries. Now we focus on the implementation of 
boundary conditions at boundaries (xo, t”) and (xy, , t") for all n as indicated in 
Fig. 3.1 that we illustrate using various physically motivated examples. 

For illustration we have to specify the numerical parameters of the IVP. We set 
the domain to [Xmin, Xmax] = [—1, 1] and ty = 2 that we discretize using Ny = 200, 
or equivalently a spatial resolution Ax — 0.01 for D ve Time resolution is set to 
At = CAx with C = 0.5. The amplitude and width of the Gaussian are set to 
A = l and ø = 0.1, respectively. 

Next we describe particular boundary conditions and their implementation. 


Explicit Boundary Values. For the IVP (3.25) it is possible to impose Dirichlet 
boundary conditions and give the values of the wave function at the boundaries 
Xo = —l and xy, = | at all times. Therefore, one can simply set the values of the 
wave function at the boundaries, say $(Xmin, f) = $n = 0 and ¢ (Xmax, t) = on, = 
0 at all times. 


In this case one avoids the problem of missing values of the wave function at 
positions with i = —1 andi = Ny + 1 as needed by the scheme (3.27) in the 
construction of on fori = 0 andi = N,. The implementation consists in 
using (3.27) in a loop with i = 1,..., Ny — 1 and afterward apply the boundary 


conditions by setting on = = = 0, as follows: 


! «Apply some boundary conditions 
! Dirichlet boundary conditions 
phi(0) = 0.0d0 

phi(Nx) = 0.0d0 


which is a particular and interesting type of boundary conditions. The result of the 
solution is shown in Fig. 3.4. Immediately after initial time, the Gaussian pulse splits 
into two smaller pulses with half the initial amplitude, but the same width, moving 
at speed one toward the boundaries. 

In the same Figure, we see that the wave function bounces from the boundaries 
with negative amplitude because the boundary conditions force the wave function 
to be zero at the edges ¢(—1,t) = @(1,t) = 0. Then at time t = 2, the two 
pulses reflected from the boundaries superpose and acquire the profile of the initial 
conditions with negative amplitude. 


Periodic Boundary Conditions. These boundary conditions are useful for the 
evolution of a wave that propagates on a periodic domain, for example, a wave 
propagating through a crystal lattice. Numerically, the domain is such that the right 
end of the domain is identified with the left end, in such a way that the topology of 
the domain changes from being a segment of a line from xo to xy,, to be a circle of 
perimeter xy, — xo as illustrated in Fig. 3.5. Thus, more than a boundary condition, 
it is a change of the domain topology, and the only boundary is that at the initial 
time surface where Cauchy boundary conditions are applied. 
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Fig. 3.4 Snapshots of the solution for the case of boundary conditions @(—1, t) = $(1,1) = 0. 
On the left we show the solution before the pulses reach the boundaries. At the right the pulses 
after reflection from the boundaries. At the bottom a bundle of snapshots together on Dg 


The implementation is based on (3.27) where i = 1,..., Nx — 1. For the 


calculation of pit! in (3.27), the index —1 must be replaced by Ny — 1, whereas 


for the calculation of One the index Ny + 1 must be substituted by 1. Using this 
information, the code of formula (3.27) for i = 0 andi = Nyx for these boundary 


conditions is as follows: 


! «Apply some boundary conditions 
! Periodic boundary conditions 


phi(0) = CFL««2 * (phi p(1) - 2.0d0 « phi p(0) + phi p(Nx-1)) 
+ 2.0d0 « phi p(0) - phi pp(0) 
phi(Nx) = CFL««2 « (phi p(1) - 2.0d0 « phi p(Nx) + phi p(Nx-1)) 


( 
+ 2.0d0 » phi p(Nx) - phi pp(Nx) 

The evolution is shown in Fig. 3.6. By t = 0.5 we see the splitting of the initial 
Gaussian pulse and by t = 1 the pulse moving to the left and the one moving to the 
right add up exactly at the boundaries, since the domain is topologically a circle. 
At t = 2 the two pulses superpose again and resemble the initial Gaussian. These 
properties are those expected for periodic boundary conditions. 
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Fig. 3.5 Identification of the spatial domain from being a line segment to being a circle. The 
boundary condition consists in the appropriate assignation of the wave function values $7 for 
i — 0,1, Ny — 1, N, that produces this effect 
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Fig. 3.6 Snapshots of the solution for the case of periodic boundary conditions. Notice that the 
solution at  — 2 is nearly the same as that at initial time ¢ = 0. The plot on the right shows 
snapshots for the time domain with tf = 3 on Dg 


Outgoing Wave Boundary Conditions. This is a useful condition that serves to 
model open boundaries that allow the wave to leave the domain. These are 
appropriate to model radiative processes of isolated systems that generate signals 
propagating out of the domain. 


The implementation of these conditions needs the following elements. The 
general solution of the wave equation is of the form $ (t, x) = g(x + t)+ h(x — t) 
with g and A arbitrary, describing a displacement toward the left and right of signals 
respectively, along the characteristic lines t/x —constant. These functions g, h are 
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solutions of the equations 


0 9 
———]220, 3.30 
(5 E ou) 
0 9 
coa 4 - 31 
(s: * 3) 0, (3.31) 


respectively. Therefore the outgoing wave boundary conditions reduce to impose 
Eq. (3.30) at x = x9 = —1 and (3.31) at x = xw, = 1, for g, h = $. Since these are 
conditions imposed on the spatial derivatives of $ at each time, they are Neumann 
conditions. 

An important issue is that in order to impose the condition at the left and right 
boundaries according to (3.27), one only counts with information from inside of the 
domain, while one needs discrete versions of (3.30) and (3.31). 

Fortunately we have constructed the discrete version of first-order derivatives 
using forward and backward stencils with second-order accuracy. For the time 
derivative, in the two equations (3.30) and (3.31), one only has the information 
in the past time levels 1" and t”~!; thus the only usable operator is the backward 
formula (3.17). For the spatial derivative in (3.30), interior points are to the right of 
i = 0, and then the forward formula (3.7) is adequate, whereas the space derivative 
for (3.31) needs the backward formula (3.8) for i = N. The stencils at boundary 
points are shown in Fig. 3.7. 

With this in mind, the discrete version of conditions (3.30)-(3.31) read 


éd | — 492 + 3937" —e5 + 48+! — 39% 1 


= O(Ax?, At’), 
2At 24x VAE 
= 1 n+1 n+1 
PN | — 40s tION | dS — ION 1 ON Eoi 
= O(Ax*, At^). (3.32 
2At T 24x a ded 
(zo, t"*?) z;,t*!) (z2, t^ **) (zu, -2,t"*! t (zu, ,t^*!) 

* E T j $ e 

(zo, t") 9.——— — —— ' D (xn, t") 


(coe) (zw, t 


Fig. 3.7 Stencils on Dg for the implementation of the boundary conditions (3.33) and (3.34) 
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Fig. 3.8 Numerical solution using outgoing wave boundary conditions. By t = 1 the wave arrives 
to the boundary and abandons the domain. The figure at the right shows the solution in the whole 
domain Dg 


From these expressions, it is possible to solve for on" and ont! in terms of known 
x 


information: 


At +1 n+l n n—-1 
^oc +4 445 — 

pit! = ax C6» ui z t-t | O(Ax?, At?), — (3.33) 

3( + 4) 

At n+l n+l n n—l 
Ax CON. 2 + 4óy. L0 + AN. — On, 

du n o A E O(Ax?, At?). (3.34) 

i 3(1+ A) 
Therefore, using (3.27) for i = 1,..., Ny — 1 together with these two formulas 


fori = O and i = N, allows the computation of the solution at time pu and 
the results are in Fig.3.8. Notice that after £ = 1 the wave leaves the numerical 
domain through the boundary as desired. The implementation follows exactly the 
formulas (3.33) and (3.34) and reads 


! «Apply some boundary conditions 
! Neumann-type, outgoing wave boundary conditions 


phi(0) = ( CFL « ( -phi(2) + 4.0d0 * phi(1) ) + 4.0d0 * phi p(0) 
- phi pp(0) ) / 3.0d0 / ( 1.0d0 + CFL ) 
phi(Nx) = ( CFL *« ( -phi(Nx-2) + 4.0d0 * phi(Nx-1) ) + 4.0d0 «x 
phi_p (Nx) 
- phi pp(Nx) ) / 3.0d0 / ( 1.0d0 + CFL ) 


Error and Convergence of the Solution 
We illustrate the convergence of the solution corresponding to the case of outgoing 
wave boundary conditions using the exact solution. The exact solution of the 


IVP (3.25), with initial conditions $9(x) = Ae-* /?^ and ġo(x) = 0, reads 


e A 2 , 2 A 2 qd 
Qe PBR = 0 Ve Tees exp[- Gero je]. (3.35) 
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In fact this is the solution even if the spatial domain is the whole IR x IR. Notice that 
the solution at initial time will be a single Gaussian of amplitude A and that time- 
symmetry holds due to the initial condition $ = 0 at t = 0. The discrete version of 
this exact solution for all x; and t” in the discrete domain Dg reads 


en A n42, 2 A ny2 7,2 
9 = m expla — 1")? /0?] + 5 expl- 1/7]. (3.36) 


The error of the numerical solution is defined at each point of Dg by 


e = oF — oF. (3.37) 
Following the hierarchy of numerical domains Dl, Dj, D3, used to construct 
solutions with successive resolutions, we calculate the numerical solutions QT ; or 
and gn using Ny = 200, 400 and 800 respectively. 

Downsampling in space and time is important for comparison of the solution at 
points of D E The code for the output including downsampling in space and time is 
as follows: 


resolution label - 1 ! use 1,2,3 for domains D1,D2,D3 
Nx-200 


Nx = 2*x«(resolution label - 1) * Nx 
do n=1,Nt 
! Integration stuff 
! Output 
if (mod(n,2**resolution_label-1).eq.0) then ! Write every 2" 
time steps 
do i-0,Nx,2««(resolution label-1) ! Write every 2" points 
write(1,*) x(i),phi(i) 
end do 
write(1,x) 
write(1,«) ! Two blank spaces are useful for gnuplot 
end if 
end do 


For each numerical solution, the error (3.37) is calculated for a convergence test. 
In Fig.3.9 a convergence tests is shown at four different times. Notice that the error 
with the coarse resolution N, — 200 is four times bigger than that with the middle 
resolution N, — 400, which in turn is four times bigger than the error using the fine 
resolution Ny = 800, which satisfies the criterion (3.21). 

Notice that by t = 1.5, the wave has already left the numerical domain; however, 
there is a finite error propagating backward from the boundaries. Remember that 
outgoing wave boundary conditions are calculated with second-order accurate 
formulas, the error is not zero at the boundaries, and part of it is reflected back into 
the domain but is expected to converge to zero with second order. Therefore, this 
convergence tests show that the implementation works and converges to the solution 
in the continuum according to theory in (3.21) for at least four representative 
snapshots, even after the signal is reflected back from the boundaries. 
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Fig. 3.9 Convergence test of the numerical solution using outgoing wave boundary conditions, 
at four different times, calculated with N, = 200, 400, 800 cells, or equivalently Ax = 
0.01, 0.005, 0.0025 respectively 
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Fig. 3.10 Convergence of Lı(e) and L2(e) norms of the error (3.37) using outgoing wave 
boundary conditions and Ny = 200, 400, 800 cells, or equivalently Ax = 0.01, 0.005, 0.0025 
respectively 


Convergence of the Norms. The convergence during the whole evolution and not 
only at a few snapshots can be tracked by calculating the convergence of the L (e) 
and L2(e) norms of the error (3.37), at each time step, using (3.24), for each of 
the three numerical solutions. The results are shown in Fig. 3.10. The norms of the 
error using the coarse resolution N, — 200 are four times that of the error using the 
middle resolution N, — 400, which in turn is four times bigger than the norm of 
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the error using the fine resolution Ny = 800. This indicates that Lı (e) and L2(e) 
converge with second order to zero. 


The Code 

Below is the code WaveSimple.f90 that solves the wave equation using the 
methods described here. It is equipped with the diagnostics tools to calculate the 
Li(e) and L5(e) norms of the error saved in files with extension .norms. It 
generates output for the one-dimensional plots with extension .dat and finally 
output that allows the generation of the fancy 2D plots in Figs. 3.4, 3.6 and 3.8 with 
extension . fancy. 


program WaveSimple 


implicit none 

real(kind-8), allocatable, dimension(:) :: phi,phi p,phi pp,x 
real(kind-8), allocatable, dimension(:) :: exact, error 
real(kind-8) dx,dt,xmin,xmax,CFL,t,amp,sigma,L1,L2 

integer i,n,Nx,Nt,resolution label 

resolution label - 1 ! use 1,2,3 for domains D1,D2,D3 

Nx - 200 

Nx = 2*x«(resolution label-1) « Nx ! Number of cells for the 
dicretized 


domain 

Nt = 2000 * 2** (resolution_label-1) 
xmin = -1.0d0 

xmax = 1.0d0 

CEL 2 0.5 

amp - 1.0d0 

sigma = 0.1 


! Alocates memory 


allocate (x(0:Nx) ,phi(0:Nx),phi_p(0:Nx) ,phi_pp(0:Nx),exact (0:Nx), 
error (0:Nx) ) 


! Define domain 


dx (xmax-xmin) /dble (Nx) 
dt = CFL * dx 

do is0,Nx 

x(i) = xmin + dble(i) * dx 
end do 


! Init arrays and time 
t = 0.0d0 

phi = 0.0d0 

phi_p = 0.0d0 

phi_pp = 0.0d0 

error = 0.0d0 


! Initial data 
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phi = amp«exp(-x««2/sigmax«2) ! Formula (3.28) 

do i-1,Nx-1 ! Formula (3.29) 

phi p(i) = phi(i) + 0.5d0 « CFL««2 * ( phi(i«1) - 2.0«phi(i) + 
phi (i-1)) 

end do 

phi p(0) = 0.0d0 

phi p(Nx) = 0.0d0 

exact = ampxexp(-x««2/sigmax«2) 

open(1,file=’WaveSimpleD.dat’) ! File for output of the solution 
open(2,file-'WaveSimpleD.fancy') ! File for the fancy 2D plots 
open(3,file-'WaveSimpleD.norms') ! File for the error norms 


! Saves data at initial time 
do i-0,Nx 

write(1,*) x(i),phi(i) 
end do 
write(1,x») 
write (1, x) 


do i=0,Nx 
write(2,*) t,x(i),phi(i) 
end do 
write (2,x) 
do n=1,Nt 
print «, n,t ! Send something to the screen 


t-t + dt ! Updates time 
|! ****x* -- LOOP CORE -- 

! Recycle arrays 

phi pp - phi p 

phi p - phi 


! Formula for the evolution (3.27) 
do i-1,Nx-1 


phi(i) = CFL««2 « (phi p(i+1) - 2.0d0 * phi p(i) 
+ phi p(i-1)) + 2.0d0 « phi p(i) - phi pp(i) 
end do 


--» Uncomment the one to be used «-- 
Fixed boundary conditions 

phi(0) = 0.0d0 

phi(Nx) = 0.0d0 


! Periodic boundary conditions 


! phi(0) = CFLx*2 * (phi p(1) - 2.0d0 * phi_p(0) 
+ phi p(Nx-1)) & + 2.0d0 « phi p(0) - phi pp(0) 
! phi(Nx) = CFL**2 * (phi p(1) - 2.0d0 * phi p(Nx) 


+ phi p(Nx-1)) & + 2.0d0 « phi p(Nx) - phi_pp (Nx) 


! Outgoing wave boundary conditions 
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phi(0) = ( CFL x ( -phi(2) + 4.0d0 * phi(1) ) + 4.080 
x phi p(0) & - phi pp(0) ) / 3.0830 / ( 1.0d0 + CFL ) 
phi(Nx) = ( CFL * ( -phi(Nx-2) + 4.0dO * phi(Nx-1) ) + 4.0d0 
* phi p(Nx) & 
- phi pp(Nx) ) / 3.0d0 / ( 1.0d0 + CFL ) 
! xxxxx -- Ends Loop Core -- 


! Exact solution only uncomment for the outgoing wave boundary 
conditions case 


exact = 0.5d0 « amp x exp(-( x - t )««2 / sigmax*2) & 
+ 0.5d0 « amp « exp(-( x + t ) «2 / sigmaxx«2) 
error - phi - exact 


! Save data on the fly 


if (mod(n,2**resolution_label) .eq.0) then ! Regular output 
do i-0,Nx,2*«xresolution label 

write(1,*) x(i),phi(i),exact(i),error(i) 

end do 

write(1,*») 

write(1,») 

end if 


if (mod(n,5).eq.0) then ! Fancy output 
write(2,*») 

do i=0,Nx 

write(2,*) t,x(i),phi(i) 

end do 

write(2,*») 

end if 


! Norms 

norml = 0.0d0 

L2 = 0.0d0 

do i=1,Nx 

11 + 0.5D0* (dabs (error (i-1)) + dabs(error(i)))xdx 
2 = L2 + 0.5D0«* (error (i-1)**2 + error(i) **2) «dx 

end do 

L2 = sqrt (L2) 

write(3,*) t,L1,L2 


p 
I 


end do 


close (3) 
close(2) 
close(1) 


end program 
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Stability 
Before finishing this section it is important to show that scheme (3.27) has a stability 
range. 


Exercise. Find empirically, using the code, that C — 1 is a threshold of 
stability. This means that using C > 1 the amplitude can grow exponentially, 
whereas using C < 1 gives a solution with a bounded amplitude. 


A proof that shows that C < 1 is a sufficient condition for stability of the 
scheme (3.27) appears in Appendix A. 


3.2.1 Dissipation and Dispersion 


Aside of the truncation error, whose theory is in Sect. 3.1 and its convergence has 
been illustrated for the wave equation in Figs. 3.9 and 3.10, there are other types of 
error that accumulate and produce important effects, manifest particularly in large 
time domains. 

This can be exemplified with the solution of the wave equation using periodic 
boundary conditions during a number of crossing times, defined as the time it takes 
a signal to travel across the domain; in the case of our wave equation, since the speed 
is one and the domain is two units wide, the crossing time is two units of time. For 
the illustration we use the same spatial resolution defined to produce Fig. 3.6, the 
only difference being the time domain, which is set to ? € [0, 50]. The results are 
in Fig. 3.11, where we show snapshots of the numerical solution every two units of 
time, so that the pulse is captured with its center at x = 0. In the continuum limit the 
figure should be the Gaussian pulse of the initial conditions superposed 25 times. 

The numerical solution presents two effects to be noticed. First, the amplitude of 
the Gaussian pulse decreases, an effect associated to dissipation. Second, the pulse 
is distorted with time, an effect associated with dispersion of the wave. The results 
are shown for three resolutions in order to see how the magnitude is in each case. 

Dissipation can be measured with the central value of $ as function of time, 
registered every time the pulse passes through the center of the domain. This is 
shown in the fourth plot of Fig. 3.11, and its smaller deviation for higher resolution 
indicates consistency. 

Different evolution schemes have different dissipation and dispersion proper- 
ties. All depends on how similar to the diffusion equation the scheme is and how 
different modes depend on propagation velocities. For example, later on in Sect. 4.4, 
we use a different integration scheme, the Method of Lines to solve the same wave 
equation as done here, and the effects of dissipation and dispersion are different 
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Fig. 3.11 Snapshots of the solution using periodic boundary conditions in the time domain [0, 50], 
every two units of time using three resolutions with Ny = 200, 400, 800. At the right-bottom we 


show the central value of $ as function of time for the three runs, which illustrates that diffusion is 
resolution dependent 


and can be seen in Figs. 4.7 and 4.8. The later is an example of how dissipation is 
important for the stability of a scheme. 


Exercise. Results in Fig.3.11 are constructed using the Courant-Friedrichs- 
Lewy factor CFL = 0.5, which illustrates the dependency on spatial 


resolution. Investigate if there is a type of dependency on time resolution by 
using CFL = 0.25. 


The code WaveSimple.f90 is available as Electronic Supplementary Mate- 
rial described in Appendix B and can be used to reproduce the results in this section. 


3.3 1+ 1 Wave Equation Using Implicit Methods 


We recall the IVP for the 1 + 1 wave equation from (3.25): 
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rp P$ 

-p a S 0 — it 

D = x € [Xmin, Xmax] x t € [0, tr] Domain 

$ (x, 0) = $o(x) Initial Conditions (3.38) 
(x, 0) = ġo) 

Q (Xmins t), (Xmax, t) Boundary Conditions 


1. For the discretization of Dg, we use exactly the construction described in the 
previous section. 

2. The discrete version of the PDE using this new method is different from (3.26). 
In this case it is assumed that the discrete version of the equation around the point 
(xi, t”) € Dg is a time average of the spatial part at times t”~! and t”+!, a method 
called Implicit Crank-Nicolson, and the discretized version of the equation is 


La 
Ax? Ax? 


gen — 29% 4e " 1 [fat 2¢"*! + ort hea — 297 Lap | 
At? 2 


+ O(Ax?, AC). (3.39) 


The wave equation is discretized using the centered version of the second deriva- 
tive in space (3.9) and time (3.18). Unlike the simple discrete version (3.26), one 
cannot isolate gr! like in (3.27), in terms of known information at times t” and 
t"—!, This is the reason why the method (3.27) is called an explicit method, 
whereas (3.39) is called implicit method. 


The strategy to solve the IVP has to be different. Let a = ue and 
rearrange (3.39) as follows: 


(a)?! + (1-209?! |, (-o)ez t] = (0097-1 + -1— 2009?! + (o9? 


+ 26" + O(Ax?, At’), (3.40) 
which defines a linear system of equations for gr. on, VAR at the interior 
points of Dg along the spatial direction i = 1,..., Ny — 1. The information in 
formula (3.40) is represented by the molecule in Fig: 3.12, to be compared with that 
in Fig. 3.3. Notice that there are now three unknowns simultaneously at time t”+!. 
Different boundary conditions define different linear systems that we illustrate here, 
because we will need to construct an appropriate evolution equation similar to (3.40) 
fori = 0 andi = N,, using only information at points of Dj. 


Dirichlet Boundary Conditions. This boundary condition sets values of $ at bound- 
aries (xo, t”) and (xy,, t") in Fig.3.1. In the example below, we use $ (xo, t) = 
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Fig. 3.12 Molecule 


2,—4,0 7! z,,t"*1 muy P 
associated to the evolution ( = ) (zi ) ( iis ) 


scheme (3.40) at points of E e e 
Dg. Black dots correspond to 
points where the value of $ is 
unknown, whereas white dots 
to points where $ is known (a; P? ) 
Dist 
O 
OQ Q OQ 


(ai-1,t”~") E (£i+1, t” i 


$ (xw, , t) = 0, and first we deal with the boundary at (xo, t”). The condition means 
that 65 = 0 for all n. Substituting i = 0 in formula (3.40), and assuming the virtual 
values of ot, fork = n — 1,n + 1 at x_ exist, one obtains 


(—a) pt! + (1420) 637! +(—a) pit! = (@)o"7!+(-1-2a) 63! +(@) of! +298. 


Now, setting oh = 0, constructing a line in the xf—plane that passes through the 
points (xo, ok) and (x1, 9b, one extrapolates the wave function at the virtual point 
and find that $^ i= — ok. This can be substituted back into the above equation and 
obtain 


(1+ 2a)¢2*! = (-1— 2a) 6"! + 267 (3.41) 


which includes only values of $ defined at points of Dg. 


At the right boundary (xx, , t”), assuming that the information at xyx+1 exists, 
Eq. (3.40) reads 


CDi L + (+ 2a)pnt! + CCo) = (009.1,  (71— 20) 65," 


+ (ay + 205. 


The boundary condition is oN, = 0 fork = n —1,n,n + 1. Constructing the line 
that passes through the points (xy, -1, oy.) and (xy, ph) where p, = 0, one 
extrapolates the virtual value on, +41 = -0k ,- Then the previous formula reduces 
to 


(1+ 20)pyt! = (-1— 2a)óN. + 29%, . (3.42) 
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Finally, formulas (3.40), (3.41), and (3.42) define the following linear tridiagonal 
system of equations: 


1+2 0 0 in 
—oa 1+2a0 -a 0 pit! 
0 —a 1+2a-a0 9! 
O-al+2v0 -a 0 AER 

0 -a 1+2a -—a ONI 


0 0 1-2e|| os. 


(-1- 2o0)g | + 267 
(apn! + (-1 — 2a)?! + (0092 | + 297 
(a)?! + (C1— 2a) 637! + (092! + 29% 


(a) Gn, 13 + (-1— 20) bh, 1, + (ON, 1, + 26%), 
pia + (C1 — 20) 9. 1, + @)ON |) + 26%), 4 
(-1— 2a)! + 20%), 
(3.43) 


that has to be solved for grt! in terms of $? and or! fori = 0,..., Ny. 
A parenthesis on the solution of tridiagonal systems is in turn. Assume the system 
of equations to be solved is Ax = d with A tridiagonal as follows: 


bo co O XQ do 
aj bi cy O X1 dı 
0 a2 b2 c2 0 x2 d» 
0 an,—2 bn,-2 ¢n,-2 9 XN,-2 dN,—2 
O0  aw,—1 bn,-1 €CN,-1 XN,—-1 dN,—1 
0 an,-1 bw, XN, dn, 
(3.44) 


The system can be solved by forward and then backward substitution [3]. For this, 
it is simple to store the nonzero entries of the matrix and the right hand side vector 
ai, bj, cj, dj as four one-dimensional arrays a,b, c,d. Since we want to make the 
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code easy, we will use arrays with i = 0,..., Ny entries, even if we waste storage 
for the entries ag and cy,. 

In terms of the arrays a,b, c, d, the auxiliary number tmp and the auxiliary 
array aux, given that bo Z 0, literally following the recipe in the Numerical Recipes 
book [3], the solution of the system can be coded as 


! Forward substitution 
tmp = b(0) 

phi(0) = d(0)/tmp 

do k=1,Nx 


1 
k) xaux (k) 
) -a(k) «phi (k-1)) /tmp 


! Backward substitution 
do k = Nx-1,0,-1 

phi(k) = phi(k) - aux(k+1) «phi (k+1) 
end do 


This is the method used to solve the system (3.43). The essential loop of the program 
that solves this problem and evolves the information using data at times t”~! and 
t" to construct the solution at time t”*! appears below. Here we assume, like in the 
previous method, that $7, P. r +l are associated to the arrays phi pp.phi p 
and phi respectively: 


| ****x* --> LOOP CORE <-- 
alpha = 0.5d0«dt««2/dx**2 


! Recycle arrays 
phi pp - phi p 


phi p - phi 
a(0) 2 0.0d0 ! waste this entry 
c(Nx) = 0.0d0 ! waste this entry 
! ZERO boundary conditions 
b(0) = (2.0d0«alpha + 1.0d0) 
c(0) = 0.0d0 
a(Nx) = 0.0d0 
b(Nx) = (2.0d0*alpha + 1.0d0) 
d(0) = - (2.0d0*alpha + 1.0d0)*phi_pp(0) + 2.0d0*phi_p(0) 
d(Nx) = - (2.0d0*alpha + 1.0d0)«phi pp(Nx) + 2.0d0*phi_p (Nx) 
do i=1,Nx-1 
a(i) = -alpha 
b(i) = (2.0d0xalpha + 1.0d0) 
c(i) = -alpha 
d(i) = alpha«phi pp(i-1) -(2.0d0«alpha + 1.0d0)«phi pp(i) & 
+ alpha«phi pp(i«1) + 2.0d0*phi_p(i) 
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! Three diagonal system solution 
! Forward substitution 

tmp = b(0) 

phi(0) = d(0)/tmp 

do is1,Nx 


1 
i)xaux(i) 
)-a(i) «phi (i-1)) /tmp 


! Backward substitution 
do i = Nx-1,0,-1 


phi(i) = phi(i) - aux(i+1) «phi (i+1) 
end do 
| xx*x*x* --» Ends Loop Core <-- 


Entries of the arrays phi (i), phi_p(i), phi pp(i) are the entries of 
the wave functions ors 7, and p respectively, that appear in the tridiagonal 
system. 

For the implementation of the method, we set the numerical parameters to the 
following. The numerical domain defined by [Xmin, Xmax] = [—1, 1], t € [0, tf], 
with Dg = ((xj, t”)} such that x; = Xmin + i Ax, with Ax = (Xmax — Xmin)/ Nx 
where N, = 200, which implies Ax = 0.01 as resolution for D}. The time 
discretization is such that At = CAx with C = 0.5. The evolution time is set 
to fy E 

The initial conditions are, like in the previous section, Cauchy boundary 
conditions consisting of a time-symmetric Gaussian pulse with $o(x) = Ae-* fo? 
and ox) = 0, where the amplitude and width are set to A = | and ø = 0.1. These 
initial conditions are implemented at time t° using (3.28) for p? and at the virtual 
time ;7! using (3.29) for $; |. 

The results are shown in Fig. 3.13, which can be compared visually with those in 
Fig. 3.4. 


Fig. 3.13 Solution for the 
boundary conditions 

o(-1,t) = $(1, t) =0. 

Pretty similar to Fig. 3.4, but yl 
this time solved using the 

implicit method 
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Outgoing Wave Boundary Conditions. These are Neumann boundary conditions 
at boundaries (xo, t") and (xw,, t") in Fig. 3.1, imposed on the space derivatives 
of $, that have to be translated into the first and last of equations that complete 
formula (3.40) for i = 0 and i = Nyx. 


First, at the left boundary (xo, t”), we impose the condition 0,6 = 0,4 as 
seen from (3.30) for g = @. Notice that formula (3.40) for i = O needs the 
unavailable values grt! and $i! that we now construct in terms of known 
information. A second-order accurate discretization of this boundary condition at 
point (xo, t”+1), centered along the spatial direction (3.5) and backward along the 
time direction (3.17), reads 


on | — 4dd + 397271 $- ont! 


O(Ax?, At?), 
2At jae 09484 ) 


whereas the discretization at point (xo, t”~!), centered along the spatial direc- 
tion (3.5) and forward along the time direction (3.16) is 


1 n—-l 

do -4p 309 — $1 —9^i 2 AD 
= O(Ax^, At^). 

2At 2p ce BM ) 


The stencils used for these two formulas are shown in Fig.3.14, where circles 
indicate the position of points belonging to D4, whereas triangles indicate positions 
out of D4 where the values of $ are unavailable. From these two expressions, 
dropping the error terms and keeping in mind these are second order, one finds 


A 
"Hl ES - (007 m. +343!) +o”, 


"iz ^ (gg - 4d + 365-1) + +p! . (3.45) 


(x 3s £873 (zo, n 1) (ay, t” 5 


Fig. 3.14 Stencils for the construction of outgoing wave boundary conditions at the left boundary 
(xo, t"). The circles indicate the position of points in Dg, whereas triangles indicate the location 
of the virtual values gt and 9" ! outside Dg 
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values that can be substituted back into the general discrete equation (3.40) for i = 0 
as follows: 


(—oa)9^1! + (1-- 2a) pnt! + (apt! = (og?! + (-1-20)4 2! 
+ (097 + 267. 


Defining x = 5 and substituting (3.45) into this expression, one finds 


Qxa + 20 + Dóo*! + (-2a)p7t! = Qka — 2a — gh! + Qo) + 29%, 
(3.46) 


which will be the first equation of the tridiagonal linear system (3.40) using outgoing 
wave boundary conditions. 

Now let us see the problem at the right boundary (xy, , t") in Fig. 3.1. In this case 
we impose the condition 9; $ = —0,@ from (3.31) for h = @. For this we construct a 
second-order accurate discretization of this condition at point (xw, , pnl), centered 
along the spatial direction (3.5) and backward along the time direction (3.17): 


1 1 
ony, — Abi, HION u Pree 7 ON 


2At 2Ax 


, 


and the discretization at point (xw, , t”—!), centered along the spatial direction (3.5) 
and forward along the time direction (3.16): 


PAD — 40h, +30 _ Phot — Pa 
2At 7 2Ax 


The stencils used for these two formulas are shown in Fig.3.15. From these 
expressions it is possible to isolate the virtual values: 


Ax z 
oi =- (oR! - 40h, + 30K) + oLa 


gl A (nt - 46%, + 39 ) HON Li (3.47) 


Substituting these expressions into the general discrete formula (3.40) leads to 


(—20) pnt? + Qko t+ 20+ DOR = Qaon 


+ (Qka — 20 — DØR! + 20%, , 
(3.48) 


which is the N, —th equation of the linear system (3.40) using these boundary con- 
ditions. In this way, Eqs. (3.46) and (3.48) complete the tridiagonal system (3.40). 
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Fig. 3.15 Stencils for the construction of outgoing boundary conditions at the right boundary 
(xw, , t”). Circles indicate the points of D4, whereas triangles indicate the location of points out of 
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Fig. 3.16 Solution for the case of outgoing wave boundary conditions. Similar to Fig. 3.8, but this 
time solved using the implicit method. At the right we show the L2(e) norm of the error that can 
be seen to converge to zero with second order, pretty similar to that in Fig. 3.10, with a different 
amplitude 


Now the tridiagonal system is complete. 

The solution using these boundary conditions is shown in Fig. 3.16, which can 
be visually compared with the solution in Fig. 3.8. 

This ends the explanation of how the Implicit Crank-Nicolson method works 
at solving the wave equation. Nevertheless the most important property of this 
method is the stability. We remind the reader that the method from the previous 
section provides a stable solution when the condition C = At/Ax < 1 is fulfilled. 

The Crank-Nicolson method is unconditionally stable, that is, the solution is 
stable despite the value of C = Aft/Ax. It is possible to use a big time step At and 
illustrate the stability property using the case of outgoing wave boundary conditions, 
keeping in mind that we have used C — 0.5 so far. We now show how the method 
performs for C — 1 and C — 2, for which we will only change the CFL parameter 
in the code, which will produce time steps two and four times bigger than in the 
construction of Fig. 3.16. The results are in Fig. 3.17. 
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Fig. 3.17 Solution and convergence of the L»(e) norm of the error to zero, for the case of outgoing 
wave boundary conditions using C — 1 at the top and C — 2 at the bottom 


The solution is stable and convergent, since the error converges to zero with second 
order according to the plots in Fig. 3.17. However, the error is bigger for bigger 
value of C and from the deformation of the solution near the pulses in the solution 
for C — 2. This is only a lesson showing that stability is a desirable property of an 
evolution scheme, but that the price to pay is accuracy. 

Notice that the discrete version in (3.39) and the boundary conditions imposed 
here are accurate to order O(Ax?, At”), or equivalently O(t’) given that At = 
C Ax. Then using a bigger C for a fixed resolution Ax implies a bigger At, which 
increases the truncation error quadratically. It can also be noticed that the solution 
with C — 2 presents a distorted wave function, a consequence of the dispersion 
error of the scheme, that becomes more evident for bigger At. Again, this is a price 
to pay for using big time steps. 


Exercise. Following the theory and examples in Appendix A, show that the 
implicit scheme (3.40) is unconditionally stable. 
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Exercise. Produce plots equivalent to those in Fig. 3.11, this time using the 
Crank-Nicolson scheme. 


The code WaveImplicit . £90 is available as Electronic Supplementary Material 
described in Appendix B and can be used to reproduce all the results in this section. 


3.4 Diffusion Equation: The Paradigm of Parabolic 
Equations 


The IVP for the 1 4- 1 diffusion equation can be defined as 


ou 9?u 

EY = Kaa u = u(x,t) 

D = x € [Xmin, Xmax] X t € [0, tf] Domain (3.49) 
u(x, 0) = u(x) Initial Conditions 

U(Xmin, t), U(Xmax, t) Boundary Conditions 


where x is the diffusion coefficient. We illustrate the numerical solution in the 
domain [Xmin, Xmax] = [0, 1] with ty = 1. The discrete domain is Dg = {(x;, t")], 
xj 2iAx,i —0,..., Ny which implies the spatial resolution Ax = 1/N,. We use 
Dirichlet boundary conditions, u(xo, t") = u(xy,, t") = 0. 

This IVP has exact solution. Let us assume «x > 0, and separation of variables 
assume u(x, t) = X (x)T (t), which substituted into Eq. (3.49) implies 


1dT 1PX | 


=K —-—K, 
T dt X dx? 


with K a constant that we assume positive. Integration of the equations for T and X 


gives 
|K |K 
T= Toe K-10) X= Acos( x +B e ( E.) : 
K K 


where To = T(0) and A, B are constants. Imposing the boundary conditions 
X(0) = X(1) = 0, one finds that A = 0 and K = xn?z?, where n is an integer. 
Setting initial time to fo = 0, the exact solution reduces to 
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u*(x,t) = X(x)T(t) = B sinnzx)e T! (3.50) 


where B is an arbitrary amplitude. This is the exact solution we will use to define 
initial conditions in numerical examples with B — 1 and to compare the numerical 
solutions with. 

At this point we use the two methods previously explored in this chapter and 
illustrate how the solutions behave. 


3.4.1 Simple Discretization Method 


A straightforward discrete version of the PDE in (3.49) is constructed using the 
expressions (3.9) and (3.13) together: 


n4l n n a n n 
li RU 2uj u$ 


e EIS + O(At, Ax’), (3.51) 


which is accurate to first order in time and second order in space if the Taylor 
expansions are developed around the point (xj, t"). From this relation it is possible 


to solve for gU in terms of past values 
At 
Tua =K (5) [uj 4.) — 2u; + uj 1] - u; + OCAt, Ax?). (3.52) 


With this expression one can calculate the value of the unknown u at point x; and 
time t”*! in terms of the values of u at previous time t". The molecule associated to 
this expression appears in Fig. 3.18. One can define time resolution through a factor 
similar to the CFL factor C :— a . Notice the quadratic dependence of At on Ax, 
which is a subtlety to take into account when setting time resolution. 


Fig. 3.18 Molecule $ n+1 n+l n+1 
Ti .U "i 244115 A 

associated to the evolution ( icut ) (zi rt ) ( Dienst ) 

scheme (3.52) at interior 

points of Dg. Black dots —e E 


correspond to positions where 
u is unknown, whereas white 
dots indicate the position 
where u is known and needed 
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Fig. 3.19 Solution using the simple discretization scheme for initial conditions with B = 1,n = 2 
and x = 1. At the left, snapshots of the numerical solution u on Dg with resolution Ax = 0.01 
and C = 0.5. At the right we show the Lı norm of the error, using resolutions Axı = 0.01 
and Ax? = 0.005 keeping C = 0.5, which implies time resolution is At) = 5 x 1075 and 
At» = 1.25 x 10? 


Initial Conditions are boundary conditions at t = 0 as seen in Fig. 3.1, and since 
the PDE is first order in time, we impose Dirichlet conditions u(x, 0) = uo(x) using 
the exact solution for t = 0, uo(x) = B sin(nz x). 

Boundary conditions at (xo, t") and (xy,,t”) are also Dirichlet conditions 
u (xo, t") = u(xw,, t") = 0. 

The numerical solution for n = 2 is shown in Fig. 3.19 for « = 1. The numerical 
parameters are N, = 100 with C = 0.5, which implies space and time resolutions 
are Ax = 0.01 and At = 0.5Ax? = 5 x 1075. As expected, the diffusion equation 
diffuses the initial data exponentially to zero. 


Convergence. A convergence test becomes a little bit subtle. Assuming a base 
resolution Ax; of D E and At; = C Au when increasing resolution Ax? = Ax1/2 
in the construction of D7 keeping C = At/Ax? constant, At = C Ax? = 
C Ax? /4 = At1/4. This means that time resolution of Di is not halved, but divided 
by four. 


Since the approximation is accurate with first order in time and second order 
in space as seen in (3.51), it should converge to first order in time and second 
order in space. In Fig. 3.19 we show the Lı norm of the error of the numerical 
solution, calculated as e; = uj — us, with u* the exact solution (3.50). The factor 
between L; (e) calculated with two resolutions is four. Let us analyze this part. The 
convergence factor is easily justified for the accuracy of the spatial operator, which 
is second-order accurate. If time resolution is doubled the convergence factor should 
be two, however, time resolution is not being increased by a factor of two but by a 
factor of four. Thus the result in Fig. 3.19 shows second-order convergence in space 
and first-order convergence in time. 


Stability. Time resolution is defined for an adequate evolution of initial data. In the 
case of this IVP the method is stable as long as the condition 
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At < ~—— (3.53) 


if satisfied. A proof is offered in Appendix A. 


The code DiffSimple.f90available as Electronic Supplementary Material, 
solves this problem is pretty similar to that used for the wave equation in Sect. 3.2. 
The main loop of the evolution code is below: 


CET; = 0.5 

| ***** --> LOOP CORE «-- 

! Recycle arrays 

up-u 

! Formula for the evolution 
do i-1,Nx-1 


u(i) = CFL +» (u p(i-«1) - 2.0d0 » u p(i) + u p(i-1)) + u p(i) 
end do 
! Zero boundary conditions 
u(0) = 0.0d0 
u(Nx) = 0.0d0 
| ***** --» Ends Loop Core <-- 


3.4.2 Implicit Crank-Nicolson Method 


This method is based on the average of the spatial part of the differential equation 
between two consecutive time slices for the calculation of the time derivative. The 
discrete version of (3.49) for this method reads 


At 2 


nl n n+l n+l n4l n n n 
ui — uj ML Tuy Mig 7 Mi uia 
Ax? Ax? 


J-OCAI^, Ax), (3.54) 


This discrete version is obtained from the Taylor expansion of u around the virtual 
point (x;, t" *V/2) = (xi, (r" *! + 1?)/2). This is the reason why the time derivative 
of u is second-order accurate here, unlike the scheme (3.52). On the other hand, the 


spatial derivative operator is averaged using its values at t”+! and t". 


At 
Ax? 


Defining a = ik ( ) one can rearrange (3.54) as 


(~out tiA)  --(-a)u? t! = (o)u? ,-(0—2e)u?-(o)u]l — (3.55) 


i+] i+] 
that defines a linear system for ius ut. e at points of Dg along the spatial 
direction fori = 1,..., Ny — 1. The information in formula (3.55) is represented 


by the molecule in Fig. 3.20, to be compared with Figs. 3.12 and 3.18. Notice the 
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Fig. 3.20 Molecule associated to the evolution scheme (3.55) at interior points of Dg. Black dots 
indicate the positions where u is unknown, whereas white dots indicate the position where u is 
known and needed. The dotted line helps to illustrate formula (3.54), obtained from Taylor series 
expansion around the point (x;, t”+!/2) that does not belong to Dy 


three unknowns simultaneously at time /"*!. The equation at boundary points will 
be defined in terms of the boundary conditions used. 

Initial conditions are the same as before. 

Boundary conditions are also Dirichlet with u(xo, t”) = u(xw,,t") = 0. For 
the implementation let us first see the boundary (xo, t”). The condition means that 
uy = 0 for all n. Substituting i = 0 in formula (3.55) and assuming the information 
at x, is available for uti fork =n — l,n + 1, one obtains 


(-a)u! + + 2o)u5! + (—a)utt! = (o)u" , + (1 — 2o)uf + (oui. 


Now, setting uk = 0, constructing a line in the xu—plane, from (xo, uk) to (x1, uk), 
one extrapolates the virtual value uk l= -uk, which substituted into the above 


equation implies the first equation of the linear system (3.55): 
(1 -2a)u?*! = (1— 2o)up, (3.56) 


which includes values of u defined on Dg only. 
At the right boundary (xy, , t"), Eq. (3.55) for i = Ny, assuming the information 
at xy x41 is available, becomes 


(au, +(1+2a)untt + (7 oux 11 = Guy 1 (O 2o), + (ous pi 


The rai condition is b = 0 fork = n,n + 1. Constructing the line from 


(XN,—1; uk Ne 2) to Xn,» uk N. ) where e — 0, one can extrapolate the virtual value 


k k 
Uy 41 = MN.) Then the previous formula reduces to 
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(1+ 2a)unt! = (1 — 20)u'y, , (3.57) 


which is the N,-th equation of system (3.55). 
Finally, formulas (3.55), (3.56), and (3.57) define the following linear tridiagonal 
system: 


142a 0 0 uy 
—a 1+2a -a 0 ur 
0  -e 1+20 —a 0 unt 
O-a1l+2a —a 0 uil, 
0 -a 1+2a -—a Wie 
n+ 
0 0 1+4+2a Wy. 
(1 — 2a)ug 
(a)ug + (1 — 2a)u + (aus 
(a)u! + (1 — 2a)u5 + (a)u5 
= : , (3.58) 


(ou. s +(1- 2a)uly 9 + (ou. 4 
(a)u'y, > +(- 2a)uy, 4 + (a)u'y, 
(1— 2a). 

that has to be solved for gv in terms of uj fori =0,..., Ny. 

The implementation of this method is illustrated for the initial conditions 
ug(x) = Bsin(nzx) with B = 1 and n = 3 in Fig.3.21, where we also show 
the convergence of Lj (e) to zero. 

The code DiffusionImplicit.f90 solves the diffusion equation using 
the Crank-Nicolson method and is available as Electronic Supplementary Material 
described in Appendix B. The essential evolution loop is the following: 


|! ***x** --> LOOP CORE <-- 
! Recycle arrays 


up-u 


! ZERO boundary conditions 


b(0) = 1.0830 + 2.0d0*alpha 

GIO) = 0.0d0 

a(Nx) = 0.0d0 

b(Nx) = 1.0d0 + 2.0d0*alpha 

d(0) = (1.0d0 - 2.0d0*alpha) *u_p(0) 
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d(Nx) = (1.0d0 - 2.0d0«alpha)xu p(Nx) 


! Entries of Matrix A and vector b for inner points do i-1,Nx-1 


a(i) = -alpha 
b(i) = 1.080 + 2.0d0«alpha 
c(i) = -alpha 
d(i) = alphaxu p(i-1) + (1.0d0 - 2.0d0x«alpha)xu p(i) 
+ alphaxu_p(i+1) 
end do 


! Forward substitution 


tmp = b(0) 
u(0) = d(0)/tmp 
do is1,Nx 
aux(i) = c(i-1)/tmp 
tmp = b(i)-a(i)xaux(i) 
u(i) = (d(i » a(i)xu(i-1))/tmp 
end do 


! Backward substitution 
do i = Nx-1,0, 


u(i) = u(i) - aux(it+1) *u(i+1) 
end do 
! ***** --» Ends Loop Core «-- 


Exercise. Solve the Diffusion equation using x = 2 and a different number of 
nodes n. 
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Fig. 3.21 Solution using the implicit Crank-Nicolson scheme with n = 3 and x = 1. At the left, 
the numerical solution u on Dg with Ax = 0.01 and C = 0.5. At the right we show the norm L; (e) 
of the error, using resolutions Ax; = 0.01 and Ax? = 0.005 keeping C = 0.5, which implies time 
resolutions At) = 5 x 1075 and Ar; = 1.25 x 107? 
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Exercise. Solve the Diffusion equation using k = 2 and CF L = 2. Show the 
explicit method is unstable whereas the Implicit method is stable. 


3.4.3 Dissipation and Dispersion Again 


In Sect. 3.2.1 above, we showed numerical solutions of the wave equation that 
illustrate the effects of dispersion and dissipation, which become evident when 
errors have more time to accumulate in long time domains. 

After solving the Diffusion equation is a good opportunity to understand the 
origin of diffusion. The formal description of these processes and applications to 
various evolution schemes can be found in Sections 7.2 and 7.3 of [1], while here 
we follow only a schematic description useful in this book. 

Consider u is a function that can be expanded as a combination of plane waves of 
the type u = tte!’ e* , If u is to be a solution of the wave equation “4 u *— a + = 0, 
the dispersion relation œ = +k between w and k must be fulfilled. This a imply 
that the solution for mode k would be written as u = ie **? that propagates at the 
k-independent velocity +1. This expression is in fact the superposition of two plane 
waves whose amplitude should be strictly time-independent. 

Consider now that u is intended to be solution of the diffusion equation m = 


ðt 
Ou, Then the dispersion-diffusion relation o = ikk? must be fulfilled, and the 


solution will be the superposition of waves of type u = ue , which are 
plane waves modulated by the decaying exponential of time, very similar to the 
exact solution in (3.50) for the diffusion equation. Notice moreover that for each 
mode k the amplitude decay is different, all originated from the dispersion relation 
for the diffusion equation. The result is that the amplitude of different modes of the 
solution decay with different rates. 

Results in Fig.3.11 for the wave equation illustrate that there are some modes 
(that in theory should not be there) that spread away from the main pulse, modes 
that can only be due to the discretization and evolution scheme used to solve the 
equation. These modes also appear in Fig.3.17 for the wave equation using the 
Crank-Nicolson method with a big CFL factor. 


EDEN 
Kkk^t gikx 


3.5 1+ 1 Schrödinger Equation 


The general form of an IVP associated to the one-dimensional Schrödinger equation 
reads 
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ow 18W 

Ex Uus T OE V = V(x,t) 

D = x € [Xmin, Xmax] x t € [0,t¢] Domain (3.59) 
V (x, 0) = W(x) Initial Conditions 

V (Xmin, t), VU (Xmax, f) Boundary Conditions 


where V (x, t) is a general potential. In this section we illustrate the solution for 
two particular cases, the particle in a box, and the particle subject to a harmonic 
oscillator potential using the Implicit Crank-Nicolson method. 


3.5.1 Particle in a 1D Box 


This case corresponds to a particle subject to the potential 


0 x € [0, 1] 
V@= (3.60) 
oo otherwise 


that is, the particle is free in the domain x € [0, 1], and the infinity potential emulates 
the solid walls of a box, which means that there W = 0. With this in mind, we 
consider the spatial domain [Xmin, Xmax] = [0, 1] and the continuity conditions on 
the wave function forces the boundary conditions to be Dirichlet type ¥ (0, t) = 
V (1, t) = 0. This is the problem we will solve numerically, but first let us construct 
the exact solution. 

Using separation of variables in the equation of (3.59) such that W(x,t) = 
V (x)T (t) and considering a time-independent potential V(x,t) = V(x), which 
is our case, the equation becomes 


LH 1 dy 
1 = 
T dt 2y dx? 


+ V(x) =E, (3.61) 


where the separation constant is the energy E. The time dependence of the wave 
function T = Tpe!£“—) and the spatial wave function y(x) must be solution of 
the stationary Schródinger equation: 


ta'y V =E 3.62 
=F aaa (x)y = Ey. (3.62) 


If V (x, t) is to be eventually normalized, one can set To = 1 and tọ = 0 without loss 
of generality and leave the normalization to the spatial wave function w(x). Then 
the time-dependent wave function would be 
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V (x, t) =e y (x). (3.63) 


In the particular case of the potential (3.60), the wave function is nonzero only in 
the domain x € [0, 1]. There V (x) = 0, and (3.62) is reduced to 


32 
ad 4H2Ew =0, (3.64) 


which is the Helmholtz equation we already solved in Chapter 1. Applying the 
Dirichlet boundary conditions ¥ (0, t) = ¥ (1, t) = 0, the solution is 


Wn, (x) = An, sin(nyT x), 


2 
TL 
pc (3.65) 
> 2 
where n, = 1,2, ... is the quantum number labeling the permitted energy values 


Es 

If one demands the wave function to be normalized, then w must satisfy 
[^ v*ydx = he A2 sin *(nyax)dx = 1, which implies Ans = 1, and the 
amplitude of the wave function reduces to An, = 4/2. This finally implies Yn, (x) = 


/2 sin(nx x). Therefore, the complete time-dependent solution for a given nx is the 
following (3.63): 


V, (x,t) = v/2e Ps! sin(nyzx). (3.66) 


The density of probability of the solution (3.66) is o = W*W = 2 sin? (n xX), 
which is time-independent. Time-independence is key to test the numerical solu- 
tion, that is, the solution has to show the harmonic time dependence of V with 
angular frequency En, whereas p has to remain constant in time. 

In Fig. 3.22 we show the exact solution at t = 0 for various values of nx, as well 
as the density of probability. The solutions can be distinguished because Re(W) for 
ny = | has no zeroes within the domain, for n, = 2 it has one zero and so on. 


3.5.2 Particle in a Harmonic Oscillator Potential 


In this case the potential is V(x) — Ikx?. Since the potential is time-independent, 
Schródinger equation separates according to (3.61) and has harmonic time depen- 
dence W(x,t) = e-F! w(x), in agreement with (3.63). For this potential the 
resulting stationary Schródinger equation is 


tex = 0, (3.67) 
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Re(V)1 


Fig. 3.22 Exact solution for the particle in the one-dimensional box [0, 1]. On the left Re(W (x, 0)) 
for n, = 0,1,2,3,4 at t = O. At the right the corresponding densities of probability p = 
V* (x, 0)v (x, 0) 


where a = Vk and f = 2E. Defining the new variable £ = /ax, one obtains 


dy AM 
wet (é-e)e=o — 


Bounded solutions for € — +00 are such that 


YE) =e! HE), 


where the equation for the H is Hermite’s equation 


4H git B 1)H=0 3.69 
dg w(i ) is Se 


whose solutions are Hermite polynomials 


Ho(£) = 1, 
Hy (E) = 2£, 
M(E) = 2 — 4£?, (3.70) 


H3(Ẹ) = 12£ — 88°, 
Ha(é) = 12 — 48£? + 1644, 
. etcetera. 


The normalized solution for y (x) is obtained from the condition f T w*wdx —1 
and reads 


Yn, (€) = e Sg, (E), 


1 
A/7 2x ny! 
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Re(‘¥)1 


Fig. 3.23 Exact solution for the particle in a harmonic oscillator potential. On the left Re(W (x, 0)) 
for ny = 0,1,2,3,4 at t = 0. At the right the corresponding densities of probability p = 
V* (x, 0)v (x, 0) 


with n, = 0, 1, 2, ..... Recovering the original variables and the time dependence 
of V, the wave-function solution is 


1 —iEn, t —x?/2 
Dn, (x, t) = Jan, e Hn, (x), (3.71) 


where the energy takes values En, = ny + 1 restricted for Hermite equation to have 
bounded solutions (see, e.g., [4]). We show the exact solution at t = O for various 
values of n, and also the density of probability in Fig. 3.23. 


3.5.3 Implicit Crank-Nicolson Method Applied to Schrödinger 
Equation 


We solve the IVP on the discrete domain Dg = {(x;, 1")) with x; = Xmin + iAx, 
where Ax = (Xmax — Xmin)/Ny and t" = nAt, with At = C Ax?. Consider one 
needs to evolve the wave function from time t” to t”*! at all space positions x; in 
the discrete domain Dg. This can be achieved with the application of the evolution 
operator to the wave function W” = V (x;, t") as follows: 


Hl -iHA 
WIE uu PERS (3.72) 
where Ê is the Hamiltonian operator in (3.59) 


i " 1 dé 
i— = Hw. d H2-—--— . 7 
i 5; ! an 243 + V(x) (3.73) 
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Expression (3.72) can be written and Taylor expanded for small At as follows: 


" e iE At 
yt = ——— YY > 
: ein Ar! 
La 
(1 — gH At) on 


i 


qe = a are 
(+ lian) 


1.4 1:4 
( + zihar) yrtl — ( = zihar) y”, 
?) i 2 : 


Rearranging the terms in such a way that the discrete first-order time derivative is 
isolated one finds that 


I. li 
v e Rut At =u! -iÂ > 


wt v v^ ly» n4l Jpn 

jt = 5 [Aap gor]. (3.74) 
Notice that this formula is Schrédinger equation with the spatial part averaged at 
times t” and t”*!, which is the essence of the Crank-Nicolson method, as illustrated 
with the wave and diffusion equations before. Notice also that (3.74) is the second- 
order accurate discrete version of Eq. (3.59) centered at the virtual point (x;, perum. 
as illustrated in Fig. 3.20 for the Diffusion equation. 

Now, let us expand (3.74) including the operator terms of H as follows: 


1 1 yn! = ayn zi yt! 
ntl i irl i i-l apnd 
y. | 2 aa + Vann! | Ar 
1 1 y" "E 2y” + y? 
— yn : i41 i i-l apn 
=ý; z| a evan ar 
LOCA, Ax), (3.75) 


which defines a tridiagonal linear system for the wave function at time 1"*. 


Defining a = H4, B= HAt and dropping the error term, the system reads 


(apt! + (1-- 2o + BV)" *! + (-o)w?*! 


i41 
= (a)U7 , --(1—2a — BV)w? + (COL AET (3.76) 
for inner points i = 1,..., Ny — 1. Boundary conditions at xj, = xo and Xmax = 


Xy, Will determine the first equation for i = 0 and the last equation of the tridiagonal 
system fori = N,. 
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3.5.3.1 Numerical Solution for the Particle in a Box 


For comparison with the exact solution, we use the spatial domain [Xmin, Xmax] = 
[0, 1]. The numerical solution is constructed on the discrete domain D4, using At = 
C Ax?. Notice that At is not proportional to Ax, instead Ax?. We set N = 100 or 
equivalently the resolution to Ax — 0.01 of D}, C = 0.125 and the time domain 
t € [0, 10]. 

In this case the Dirichlet type of boundary conditions are appropriate on the wave 
function v(0,t) = W(1,t) = 0, that is, we require VY = WN, = 0 for all k. 
Assuming there are virtual values for v^ and Vt. 41 


which take values 


Vr = Vr and VS ul = VA 
to second order, which results from connecting the point (xo, d — 0) and (x1, wk ) 
and extrapolate with a line the value y* p and (xw, , WN, = 0) with (xy, -1, WE y 
allows the extrapolation of VN. 41: These virtual values can be used in Eq. (3.76) 
with i = 0 andi = N, to construct the first and last equations of the tridiagonal 
system, which are 


(1 + 2a + BV) wer! = (1 — 2a — BVo) yy, at the left boundary (xo, t”), 


(1+ 2a + BVN) DAT = (1 — 2a — Vn,)Wy,» at the right boundary (xw,, t”). 


These conditions are constructed for any time-independent potential V. For the 
case of a particle in a box V = 0 in the numerical domain x € [0, 1], therefore the 
system simplifies. Using the later two expressions together with (3.76), the linear 
system to be solved for the evolution reads 


1+2 0 0 Vo 
—a 1+2a -a 0 ypt 
0 —a 14+2a-a0 V 


O-a1l+2a -—a 0 pU 
0 -a 14+2a -a P] 
0 0 1420] ] wrt! 
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(1 — 2a)u 
(aW + (1 2a) V? + (a) uz 
(aw + (1 — 2a)? + (a) uz 


= . ' (3.77) 


(ayy .--(1—20)Us a + (oU 
(a) + (1 — 2a), + (ay, 
(1 — 2a) Wy 


In order to solve this system, we use the method described for the generic 
tridiagonal case (3.44), which determines the evolution of V/" from t" to pel 
Consider now that the entries of the system are complex, which requires the 
definition of arrays of complex entries psi and psi p for go and V7, 
respectively, and for the matrix and vector elements a, b, c, d. 

The workhorse example will be the case ny = 2. As initial conditions we use the 
exact solution (3.66) at t = 0, v» = J/2 sin(27rx), that is, we fill in the array of the 
wave function at initial time as follows: 


v? = /2sinQ2rx;) + 0i, 


and these initial data are evolved using the scheme (3.77) at each time step. 


Diagnostics of the Solution. The first diagnostics consists in showing that the wave 
function ¥ oscillates, whereas the density of probability o = W*W remains time- 
independent. This is shown in Fig. 3.24. 


The second physical diagnostics is the unitarity of the evolution. This means that 
the number of particles in the domain, namely, N — [^ pdx, has to remain constant 
in time. The result is calculated using the trapezoidal rule (3.23) and is shown in 
Fig. 3.24. The value of N in this solution deviates from one only by 107? over the 
time window used. 

Finally, the error of the numerical solution is estimated for the real part of the 
wave function at every point of (xj, t”) € Dg, as the numerical solution minus the 
exact solution: 


e? = Re(W") — Re(Vf^). (3.78) 


In order to show the numerical solution is convergent, we calculate L»(e?) 
using (3.24), as function of time for N, — 100, 200, and 400 or, equivalently, 
resolutions Ax = 0.01, 0.005, and 0.0025. The result appears in Fig. 3.24. The 
factor between the errors using consecutive resolutions is nearly four, although we 
decided to present the error using a log plot which is common in long runs. In a 


3.5 1+ 1 Schrödinger Equation 147 


2 
15 
E 
a 
Ey 1 
a 
05 
0 
0 02 04 0.6 08 1 
x x 
1.001 
0.100000 E E 
1.0008 DE eee 
1.0006 Ax=0.0025 -= iiil 
1.0004 0.010000 
1.0002 
s. 
z 1 eS 
J 0.001000 
0.9998 
0.9996 
0.000100 | 
0.9994 ii 
0.9992 
0.999 a T E e 0.000010 
0 1 2 8 4 5 6 7 8 9 10 0 


Fig. 3.24 Numerical solution for the particle in a box with n, — 2, using Ax — 0.01 and C — 
0.125. At the top we show snapshots of Re(V/) and p at various times. This shows the wave function 
oscillates, whereas the density remains nearly stationary. At the bottom we show that the integral 


N= i pdx remains nearly constant in time. Finally we show the convergence of the L2(e) norm 
of the error (3.78) to zero, using the numerical solution calculated with various resolutions 


semi-log plot, the difference between the solutions in Di and D3, should be nearly 
the same as the difference between the solutions in DŽ and D. 


All these diagnostics indicate that the numerical solution for the particle in a box 
is reliable. 


Exercise. Enhance the code below, to calculate Re(W) at x = 0.25 as a 
function of time. The result will be a time series with the value of the wave 
function at this position that oscillates in time. Then calculate the Fourier 
Transform with an external software and show that the dominant peak is found 
approximately at the angular frequency E2 = (27)*/2. 


Exercise. Adapt the proof for the stability of the Crank-Nicolson equa- 
tion applied to the Diffusion Equation in Appendix A, and show that the 
scheme (3.76) is unconditionally stable. 
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Fig. 3.25 Numerical solution for the particle in a box with ny = 2, using various resolutions and 
C — 1. We show that the integral N remains nearly constant in time during the evolution. Finally 
we show the convergence of the L»(e) norm of the error (3.78) to zero 


An effect of doubling resolution, halving Ax, is that in order to cover the time 
domain the number of time steps if four times bigger if we keep C constant in the 
relation At = C Ax’. Since this method is unconditionally stable for any value of 
At, let us use C = 1, which implies the code will execute 1/8 of the time-steps 
than with the value C = 0.125 used before. The evolution of V and p is shown in 
Fig. 3.25, and the results are very similar to those in 3.24. We show the preservation 
of N and the convergence of the error. Notice that the L2 norm of the error is of the 
same order as that using C — 0.125, which indicates the solution is nearly as good 
as when using a small time step. 

Results in Figs.3.24 and 3.25 are obtained using CFL=0.125 and CFL-1 
respectively, in the code provided at the end of this section. 


Challenge. Using C = 2, estimate £y such that the change in the number of 
particles deviates more than 1%. 


3.5.3.2 Numerical Solution for the Particle in a Harmonic Oscillator 
Potential 


Boundary conditions in this case are different from those for the particle in the box. 
The reason is that within the numerical domain, the wave function decays with a 
Gaussian profile very fast, but is not zero. Therefore a more appropriate condition is 
that the space derivative of V at the boundaries vanishes, which is Neumann type. 

Assuming there are virtual values for wk 1 and Vx. "T fork = n,n + 1, one can 
use the centered formula for the first-order spatial derivative at the boundary points 
and find the relations: 
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wk — wk 
1 —1 k k 
=0 2 w*,-wf, 
2Ax id 1 
wk wk 
Ny Ny—1 k k 
Ax —1 0 = VN AH — Wy aa 


Using these expressions into (3.76), we find the equations to be fulfilled at the 
boundaries: 


(1+ 2o 4- BVo) wet! + (—2aywrt! = (1— 2a — BV) we + Qa), 


(-20) wy + (1+ 20+ BV, WAT! = Qa)ywy , + (1— 20 — BVN YR, . 


In this case the potential is V = 5x, defined in the numerical domain for each 
xj as V; = 1x2. Using these two expressions together with (3.76), the linear system 


to be solved for the evolution reads: 


1 2o + BV —2a 0 
—a 1+2a + BV, —a 0 
0 —a 1+2a + V2 —a 0 
0 —a 1+2a+BVy,—2 —a 0 
0 —ao 1+ 2a t BVy,—1 —a 
L 0 —2a 1+20+BVy, | 
B T ms - 
vo | ad — 2a — Vo) Wi 2o 
rH (aU + (1 2a — pV I! + (o)? 
wati (wy! + (1 — 2a — BV3)UZ! + (aud? 
5 (3.79) 
n+l n n n 
YN 2 WYN -3 + (1 —- 2a — BVN —2)¥ N29 + (YN 4 
n+l n n n 
V LL (UR y 0720 — BV, LUN | E GOV 
n+l n n 
Ln dJ L 2awy 1 +O- 2a — BVN ON | 


The numerical solution is constructed on the discrete domain Dg = {(x;, t")), with 
Xi = Xmin + i Ax where Ax = (Xmax — Xmin)/ Nx and At = C Ax?. In this case 
we set [Xmin, Xmax] = [—10, 10], for the wave function to have space to vanish due 
to the Gaussian envelope. We set Ny = 2000 or equivalently Ax = 0.01 as the 
resolution for Dg, C = 0.125 and the time domain to ¢ € [0, 10]. 
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The workhorse example will be the case ny = 3. As initial conditions we use the 
exact solution (3.71) at t = 0: 


1 1 
V, (x, 0) = | —À—e Hx) = | ———e "02x — 8x3), — (3.80) 
: J23! WEZE 


and the array of the wave function at initial time is filled with values 


1 =? 
y? = FEB” SP (12x; — 81), (3.81) 


which is evolved over the time domain using the scheme (3.79). 

Diagnostics of the solution. Like for the particle in the box, the first diagnostics 
consists in showing that the wave function W oscillates, whereas the density of 
probability o. = W*W remains time-independent. This is shown in Fig. 3.26. 
Secondly, the unitarity of the solution is shown through the conservation of N = 
[2 pdx, also shown in Fig. 3.26. 
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Fig. 3.26 Numerical solution for the particle in a harmonic oscillator potential with n, = 3 using 
Ax = 0.01 and C = 0.125. At the top we show snapshots of Re(V/) and the density of probability o 
at various times. This shows that the wave function oscillates, whereas the density remains nearly 
time-independent. At the bottom we show that the integral N remains nearly constant in time. 
Finally we show the convergence of the L»(e) norm of the error to zero with second order 
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The error of the numerical solution is estimated for the real part of the wave 
function at every point (x;, t”) € Dg using Eq. (3.78). Finally, in order to show 
that the numerical solution converges to the exact solution, we calculate L»(e?) 
as function of time for N — 2000, 4000, 8000 or equivalently resolutions 
Ax = 0.01, 0.005, 0.0025. The resulting value of L»(e7) appears also in Fig. 3.26, 
showing second-order convergence of the error to zero. Unlike the particle in the 
box, for completeness, here we show a typical plot in a linear escale of the L2 norm 
of the error, where the convergence factor close to 2? is consistent with the second- 
order accuracy of the methods. 


Exercise. Enhance the code to calculate Re(W) at the point where this 
function acquires its maximum. Then carry out a Fourier Transform of the 
resulting time series with an external software and show the peak frequency 
is approximately E3 = 3 + 1/2. 


Exercise. Results in Fig. 3.26 can be reproduced with CFL=0.125 using 
the code below. Consider experiments with bigger values of C in order to 
measure execution time, error amplitudes, and convergence. Also it is possible 
to evolve initial conditions with n, — 1, 2, 3, 4. 


The code SchroedingerImplicit.f90 can be used to solve Schródinger 
equation for the cases in this section and is listed in Appendix B. 


3.6 How to Improve the Methods in this Chapter 


We defined and used the basic methods for the solution of IVPs in 1 4- 1 dimensions. 
The codes provided are a template where a garden variety of methods can be 
implemented for another universe of problems. We recommend to study the methods 
and examples in reference [1]. 


3.7 Projects 


With the methods described in this chapter, it is possible to carry out the following 
projects. 
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3.71  Bosonic Dark Matter 


This model proposes that dark matter is an ultralight spinless particle, whose 
dynamics is ruled by the Gross-Pitaevskii equation suitable for a Bose gas, which 
mathematically is Schródinger equation with a macroscopic interpretation. The 
potential in this equation is the gravitational potential sourced by the density of 
the bosonic gas itself that obeys Poisson equation. 

The problems described in this chapter are defined in 1 + 1 dimensions, yet when 
a three-dimensional problem has spherical symmetry, it can be translated into a 1+ 1 
problem in spherical coordinates. The equations that rule the dynamics of bosonic 
dark matter in spherical symmetry and spherical coordinates are 


Ow 1 a2(rW) aay 
1 = ‘ 
ot 2r ðr? 
8?(rV) 
7 mE r|v p, (3.82) 


respectively, Schródinger and Poisson equations. This is an IVP with constrained 
evolution, that is, the wave function evolves according to Schródinger equation, 
whereas the potential is sourced by the density |W|* itself, and V has to be updated 
during the evolution because W is time-dependent. 

The collapse of fluctuations that eventually may form galaxies can be studied 
by solving these equations. With some modifications of the code provided here to 
solve Schródinger equation, the evolution, collapse, and relaxation of a fluctuation 
can be studied as indicated in [5]. For the evolution of the system, the same Crank- 
Nicolson method described here is used in [5], whereas Poisson equation can be 
solved at each time step using a Runge-Kutta method just like the one used for the 
solution of TOV equations in Chapter 1. 


3.7.2 Newtonian Boson Stars 


The problem above has a special set of solutions that are stationary. Their con- 
struction assumes that the time dependence of W is harmonic in time, and 
therefore the source of Poisson equation is time-independent, which leads to a 
stationary potential. The resulting stationary Schródinger equation is solved using 
the Shooting method described in Sect. 2.11.8. A detailed description to follow for 
the construction of these solutions can be found in [6]. 

Once these solutions are constructed, they can be used as initial conditions for the 
solution of the system (3.82). Then Boson Stars can be perturbed, and it is possible 
to study their stability and oscillation modes. 
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Chapter 4 M) 
Method of Lines for Initial Value chete 
Problems Involving PDEs 


Abstract In this chapter, we describe the method of lines (MoL) and apply it 
to various of the problems solved above in order to compare properties. The 
first example used is the advection equation, which is adequate to the methods 
since it is a first-order equation in space and time. Later on, we solve the wave 
equation, which needs a little work to bring it from second to first order. We 
illustrate the power of the MoL with the wave equation on a general Minkowski 
space-time, which also helps illustrating some concepts of relativistic physics. We 
also solve Schrödinger equation with this method and compare the solutions with 
those constructed previously. We finalize the chapter with an advanced problem of 
relativity, the accretion of a spherical wave by a black hole. 


Keywords Partial differential equations - Method of lines - Wave equation - 
Schrödinger equation - Diffusion equation - Error theory - Convergence 


In this chapter, we describe the method of lines (MoL) and apply it to various of the 
problems solved above in order to compare properties. The first example used is the 
advection equation, which is adequate to the methods since it is a first-order equation 
in space and time. Later on, we solve the wave equation, which needs a little work 
to bring it from second to first order. We illustrate the power of the MoL with the 
wave equation on a general Minkowski space-time, which also helps illustrating 
some concepts of relativistic physics. We also solve Schródinger equation with this 
method and compare the solutions with those constructed previously. We finalize 
the chapter with an advanced problem of relativity, the accretion of a spherical wave 
by a black hole. 


4.1 Method of Lines 


Assume that the IVP of interest is associated with a first order in time PDE defined 
on a two-dimensional domain, described with independent variables (x, t), where t 
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represents time and x a spatial coordinate. A sufficiently general case that contains 
all the examples developed in this chapter has the form 


af af a 
combination of (s t, f, T a x) —g(x,t) f= f(x,t) 
D = x € [Xmin: Xmax] X t € [0, ty] Domain 
f(x,0) = fo) Initial Conditions 
f Ginins t), f Ginax, t) Boundary Conditions 
(4.1) 
and is such that the PDE can be written as 
of 
— =rh 4.2 
$5 sCf) (4.2) 


where the right-hand side (rhs) defines the evolution of f. 

The idea is to construct a numerical solution to the above IVP on the numerical 
domain Dg defined as the set of points (x;, t”), with x; = Xmin +i Ax, i = 0, ..., Nx, 
AX = (Xmax — Xmin)/ Nx and t” = n At. Assuming that for each point (x;, t”) € Dg, 
it is possible to define an evolution equation of the form 


af 


(x;,t”) 0x? 


er = rhs (s t", f at 


Qj) OX 


, 


Gri t") 


; 4.3 
ðt (xj n) d 
which is an ODE for f at each spatial point x;, to be integrated in time from t” to 
t+! [n fact, this is an IVP in the time domain t € [0, tf] for each x;. This approach 
is called the method of lines (MoL), because the solution to the IVP associated with 
a PDE will be the solution of N, + 1 ODEs integrated along lines of constant spatial 
position x; for i = 0, ..., Nx. 

The objective of the MoL is the construction of a solution to the IVP by solving 
the N, + 1 ODEs using the integrators described in Chap. 2. 


4.2 Time Integrators 


Equation (4.3) is called the semi discrete version of the PDE when the right-hand 
side is written in terms of the discrete version of f and its spatial derivatives. 

The time integration of f from (xj, t") to (xj, 1*1) can use an integrator of 
ODEs. We use the Heun flavor of the RK2 method from Sect. 2.8 to illustrate how. 
The integration of ay = rhs(x;, t", f?) would be, according to Eqs. (2.32) for each 
xj, as follows: Identifying from (2.32) and (2.33) the unknown u at time #;_; with 
the unknown f at point (xj, t”) as seen in Fig. 4.1, uj; — f’ and the slope kı > 
rhs( 7), the argument of kz is uj. + Ky At > f? + rhs(f/")At :— f* and finally 
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qui 
uj d 
O 
7 
Uj-1 Uu 
O 
| 
————————9— 
t; [i (24, 0*) 


Fig. 4.1 Left, illustration of the integration of the unknown u of an ODE at the left, from point 
t;-1 to t; of the numerical domain, as seen in Figs. 2.2 and 2.4. Right, integration of f of a PDE 
from space-time point (xi, t”) to (xi, t+!) of the numerical domain 


k2 — rhs(f*). With this, the integration of f from (x;, t") to (x;,t"t!) can be 
expressed as 


x gn n _ gn ae 
fE = fi ths (f) At = fP+hat dc 


1 1 
po Lc (54 + ze) At 


1 1 
= ff + 5laAt + sths (ff) At 


|j, - H 1 
At hs ( f*) At 
2 At tats) 


= fa 


Gs + f* + rhs (fr) At) : (4.4) 


This method can be implemented in two steps, for each x;, as follows: 


! Heun RK2 
do rk=1,2 
calculate rhs f ! With a discrete version of the rhs 
if (rk.eq.1) then 
f - f p+ rhs f » dt 
else 
f = 0.5d0 « (f p + f + rhs f + dt) 
end if 
end do 
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Other flavors of RK2 or other ODE integrators can be implemented as well. For 
example, a method that we will use frequently is a third-order Runge-Kutta (RK3) 
method described in [1]: 


m 
* 
II 


f? 4t rhs(f7) At, 
ge — + le +  ms( f) At 
i 4 i 4 i 4 4 , 
1 2 2 
f = BAP + BA + gsm, (69 


which can be programmed as follows: 


! RK3 
do rk=1,3 
calculate rhs f ! With a discretization on D; 
if (rk.eq.1) then 
dt temp - dt 
f = f p + dt_temp x rhs f 
else if (rk.eq.2) then 
dt temp = 0.25 » dt 
f = 0.75 x f p+ 0.25 x f + dt temp « rhs f 


else 
dt temp = 2.0D0 * dt / 3.0D0 
f = fp / 3.0D0 + 2.0D0 « f / 3.0D0 + dt temp + rhs f 
end if 
end do 


For the implementation of these two methods, three basic one-dimensional arrays 
have to be defined: 


— One for entries of f 


— One for entries of f,’ ix 


— One for the right-hand side of the semi-discrete Eq. (4.3) rhs |. f 


with Ny + 1 entries i = O, ..., Ny. With these arrays, it is possible to integrate the 
semi-discrete expression (4.3) using only two time levels of f stored. The arrays 
can be recycled after each time step as follows: 
qe zx i : 

and then release the memory assigned to the array associated with Tet Integrators 
(4.4) and (4.5) will be very used in the forthcoming examples; sometimes, we use 
Heun RK2 and some others RK3. 

When instead of a single equation the IVP involves a set of k coupled equations 
O;u, = rhs(u4),...,Qyuy = rhs(uj), the evolution method has to be applied to each 
of the unknowns uj, ..., Uk. 


4.3 Advection Equation 159 
4.3 Advection Equation 


The advection equation is a good first example of IVP because the PDE is first order 
in time and space. The problem is formulated as follows: 


c Fal. =0 u = u(x,t) 

D = x € [Xmin; Xmax] X t € [0,t¢] Domain (4.6) 
u(x, 0) = uo(x) Initial Conditions 

U(Xmin, t), M (Xmax, f) Boundary Conditions 


We construct a discrete domain Dg as done previously, with points (x;, t”) = 
(Xmin + i Ax, n At), where Ax = (Xmax — Xmin)/ Nx and At = C Ax. 

The spatial derivative of the advection equation is written using the second-order 
accurate approximation (3.5). With these elements, the semi-discrete version of the 
advection equation at the interior point (xj, t”) € Dg reads 


8 u? gc 
= = atl i 4 O(Ax?). (4.7) 
Ot (xj t") 2Ax 


This illustrates how the rhs of the time derivative of u is a number, namely, the 
discrete version of the spatial derivative of u in (4.6). The molecule that illustrates 
this method is shown at the left in Fig. 4.2. 

For the example of numerical solution, we use the domain Dg with 
[Xmin; Xmax] = [—1,1] and tf = 2, as well as Ny = 200, which implies a 
resolution Ax = 0.01, and C = 0.5, which implies At = 0.005. 

Initial conditions are Dirichlet boundary conditions at the boundary t = O in 
Fig. 3.1, given by a Gaussian u(x, 0) = uo(x) = Aexp(—x?/o?) with A = 1 and 
o — 0.1. 


n+l 
(zi,t ) (za, t^!) 


(zi-1,t") (zi, t^) (53, t") (zw.-2,7) — (zw,-i,t") (zw, .t) 


Fig. 4.2 Left molecule illustrating scheme for the advection equation in Eq.(4.7). Right: 
molecule for the implementation of the boundary condition at the x — xy,, using the one-sided 
backward discrete derivative in Eq. (4.8) 
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Boundary Conditions. The advection equation in (4.6) drives the initial conditions 
along the characteristic line f. = x across the domain, and the pulse will move 
toward the right side of the spatial domain. Knowing this, we use the following set 
of boundary conditions: 


— Impose a Dirichlet condition u(xo, t”) = 0 at the left boundary (xo, t") of 
Fig. 3.1. 

— Use the Neumann outgoing wave boundary condition at the right boundary 
(xw, t"). For this condition, one has to solve Eq. (3.31), d;4 + d,u = O, this 
time using the MoL. The semi-discrete version of this equation at the boundary 
is 


9 uM y= Aui _, 3 
De ——á Nac Ne LO(Ax2), (4.8) 
yot”) 2Ax 


where the second-order accurate backward derivative (3.8) is used at i = Ny. 


The code that solves this problem is MoLAdvection.f90. Here, we show the 
core of the code, that is, the time integration loop using the Heun RK2 integrator. 


do n=1,Nt 
t = t + dt ! Updates time 


|o x**** --> LOOP CORE «-- 
! Recycle arrays 
up-u 
! Heun RK2 
do rk=1,2 
! Calculate the RHS 
do i=1,Nx-1 


rhs u(i) = - 0.5d0 x a * ( u(i+1) - u(i-1) ) / dx 
end do 
! Now at the boundaries 
rhs_u(0) = 0.0d0 
rhs u(Nx) = -0.5d0xa«( u(Nx-2) - 4.0d0 «x u(Nx-1) + 3.0d0 
* u(Nx) ) / dx 


if (rk.eq.1) then 
u = u p + rhs u * dt 


else 
u = 0.5d0 « (u p + u + rhs u x dt) 
end if 
end do 
| ***** --» Ends Loop Core «-- 


Calculate the exact solution 
Calculate the error 

Calculate norms L1 and L2 of errors 
Save data in ordinary and fancy ways 


end do 
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Fig. 4.3 Numerical solution 

of the advection equation for 1 
a = 1, using Ny = 200, or 

equivalently Ax = 0.01 and u 05 
C=0.5 


DU 
WR 
IM 
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| W 
CD 


m ines 
AO 


Notice that we indicate a Loop Core, an essential piece of code that will be 
used and adapted in the further examples in this chapter. 

The resulting numerical solution is shown for a = 1 in Fig.4.3. The pulse 
evolves, and the boundary conditions do as expected, fixed at the left and outgoing 
wave at the right. Notice that the solution corresponds to one of the pulses of the 
wave equation in Figs. 3.8 or 3.16. 

The exact solution to this IVP for the initial Gaussian pulse is u^ = A exp[—(x — 
i jo" |, which we use to calculate the error of the numerical solution e = u — 
u*, and its convergence to zero. The time integrator RK2 is second-order accurate, 
the discrete version of the spatial derivative in (4.7) is second-order accurate as 
well, and the semi-discrete version of the boundary condition at the right end (4.8) 
is also second-order accurate. In summary, the error is second order, and second- 
order convergence is expected as long as the evolution is stable according to Lax 
Theorem [1]. 

In Fig. 4.4, we show the Lı and Lz norms of the error, calculated with formulas 
(3.24), for three resolutions N, = 200, 400, and 800 or equivalently Ax; = 0.01, 
Ax2 = Ax1/2, and Ax3 = Ax2/2. The convergence of the error is second order, 
which indicates that the implementation is correct and that the resolution used is 
within the convergent regime. 

Let us now implement the RK3 method (4.5). The loop core corresponding to the 
implementation of this method for the advection equation reads 


| ****x --> LOOP CORE «-- 
! RK3 
do rk=1,3 
! Calculate the RHS 
do i=1,Nx-1 
rhs u(i) = - 0.5d0 « a * ( u(i«1) - u(i-1) ) / dx 
end do 
! Now at the boundaries 
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Fig. 4.4 Norms L,(e) and L2(e) of the error. Notice that the approximate factor is four between 
the error calculated using successive resolutions which indicates second-order convergence of the 
two norms to zero 


rhs u(0) = 0.0d0 
rhs u(Nx) = -0.5d0 » a * ( u(Nx-2) - 4.0d0 x u(Nx-1) 
+ 3.0d0 * u(Nx) ) / dx 
if (rk.eq.1) then 
dt temp - dt 
u =u p dt temp +» rhs u 
else if (rk.eq.2) then 
dt temp = 0.25 * dt 
u = 0.75 x up + 0.25 x u + dt temp * rhs u 
else 
dt temp = 2.0D0 « dt / 3.0D0 
u= up / 3.0D0 + 2.0D0 « u / 3.0D0 + dt temp 
* rhs u 
end if 
end do 
| ***** --» Ends Loop Core «-- 


The result of a convergence test using the RK3 integrator would be very similar 
to that in Fig. 4.4, including the second-order convergence expected for the RK2 
method. It means that despite of using a third-order accurate method for time 
integration, the convergence would still be second order. The reason is that the 
accuracy of the solution will be dominated by the leading order error. In this case, 
the time integration is third-order accurate; however, the discretization of the rhs(u) 
is second order, and then the overall error is expected to be second order. 

Even though the accuracy is second order, we will use the RK3 integrator in 
various of the following examples because it is more stable than the RK2 and is 
equally easy to implement: 
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Exercise. Solve the advection equation with a = 0.5, and verify that it takes 
the Gaussian pulse twice the time to arrive at the boundary compared to the 
case when a = 1. 


4.4 141 Wave Equation 


The advection equation serves as a guide to implement the solution of first order 
in time PDEs using the method of lines. We would like to apply this method to 
solve the wave equation, and part of the work consists in converting a second-order 
equation in space and time, into a system of first-order equations. 

This can be done by defining the variables: 


ap ap 
eS 
y Ox ot 
2 2 < 
in terms of which the wave equation I = € = 0 can be written as əx E au 


which is an evolution equation for 2. However, the definition of w is a constraint 
that must be satisfied at all times. Therefore, it is necessary to construct an evolution 
equation for w, which can be done as follows: ov = 2 2 T= i i = on , provided 
¢ is at least of class C?. 

For ease, from now on, we will use indistinctly the notation 0, f = df/dt and 
əx f = 0f/0x. Considering this, the wave equation is converted into a system of 


two first-order equations: 


OW = oy, 

dr = Ox y. 
This system of equations can be solved using the MoL; however, the solution would 
be for the auxiliary functions y and zr, while the original goal is the construction 
of ¢. The wave function can be integrated at the same time as y and zt by adding a 
third equation that is actually the definition of v: 


TO) =T. 


With these three equations, one can formulate the following IVP: 
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Qj = 0.0 
dn = Oy y 
do = 7 $ — ó(x,t), V = VG, t), m= r(x, t) 
D = x € [Xmin: Xmax] x t € [0, ty] Domain 
$ (x, 0) = $o(x), W(x, 0) = Wo), 
zt (x, 0) = mo(x) Initial Conditions 
(Xminst), Xmax, t) 
W(OXmin, t), YXmax, t) 
T (Xmin, t), T (Xmax, f) Boundary Conditions 


(4.9) 


The IVP will be solved using the MoL on the domain Dg with points (x;, t”) = 
(Xmin + i Ax, nAt), where Ax = (Xmax — Xmin)/ Nx and At = C Ax. The semi- 
discrete version of the evolution equations in (4.9), at the point (x;, t”), using the 
second-order accurate formula of the spatial derivative, reads 


wr, — 7? 
ay = = + O(Ax?), 


2Ax 
n n 
AES 
ar = HL + O(Ax), 
tT 2Ax + O(Ax*) 
9,9 = nj, (4.10) 
valid at the interior points of the domain i = 1, ..., V, — 1. For this system of three 


equations, one-dimensional arrays are needed for Qt, p”, rhs(@), yt, y", 
rhs(y), x" *!, a”, and rhs(z). 

Initial conditions are Dirichlet boundary condition for each variable at the side 
(x, 0) instead of Cauchy conditions as in Sect. 3.2. Nevertheless, we will set the 
same time-symmetric Gaussian pulse, which in terms of the wave function and the 
auxiliary variables reads: 


3722 2x 
poa) = Ae ^, Yol) = — = Fol), T(x) = 0, (4.11) 


with A = 1 and ø = 0.1. Notice that time symmetry means simply zo(x) = 0 
and that the initial conditions of the three variables are set at time t = 1°, unlike 
in Sect. 3.2, where information on two time slices was needed in order to set time- 
symmetric initial conditions. 

At boundaries (xo, t^) and (xy,,t”), we impose outgoing wave boundary 
conditions. The implementation can be done in various ways; here, we show one 
strategy and will show a more sophisticated one later on when we solve the wave 
equation on a general Minkowski space-time. 
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At the boundary at (xg, t”), the outgoing wave equation to be satisfied is 
Eq. (3.30), 3p = 0,9, which is Neumann-type and can be semi-discretized using 
the forward formula (3.7) as follows: 


4t — 40 +345 
2Ax 


9, = + O(Ax?). (4.12) 
With this semi-discrete version, $ can be integrated up to the boundary. Now, the 
condition on y, let ¢;' be the value of the wave function at this boundary at the 
intermediate iteration m within the RK integrator, it is possible to calculate the 
spatial derivative of $, yọ’ using the forward approximation (3.7): 


os — 491! +34 


o Ax’). 4.1 
E + O(Ax^) (4.13) 


y? = 
0 = 


Finally, the outgoing wave condition itself is a relation between w and rr, that is, 
drh = 0,6 at this left boundary: 


a! = yi. (4.14) 


Expressions (4.12), (4.13), and (4.14) provide the values for all the three variables 
at (xo, t”). 

At the right boundary (xw, , t”), the equation to be fulfilled is (3.31), 3 = 
— 0,4. Proceeding analogously, $ can be integrated up to the boundary using the 
appropriate backward formula for the spatial derivative (3.8): 


on, 2 » AON, i id 30N, 
24x 


ao = + O(Ax?). 

Knowing that the value of dy, allows the calculation of wy, and my,, using again 
the definition of y and the boundary condition, the values of the auxiliary variables 
are: 


68,2 7 498, ., 308 
m = x x x O A 2 ; 
Zi a HOE) 


RN, = TVN? (4.15) 


at all intermediate steps m of the RK integrator. In this strategy, the order of the 
instructions within the program is important. The Loop Core of the code that 
implements the evolution using these boundary conditions can be as follows. We 
show the code for the Heun RK2 method, but the implementation using the RK3 
method is analogous: 


| s**xe* --=> LOOP CORE «-- 
! Recycle arrays 
phi p - phi 
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psi p - psi 
pip - pi 


Mid-point RK2 


do rk-1,2 


! Calculate the RHS at the interior 
do i-1,Nx-1 


rhs psi(i) = 0.5d0 « ( pi(i«1) - pi(i-1) ) / dx 
rhs pi(i) = 0.5d0 « ( psi(i+1) - psi(i-1) ) / dx 
rhs phi(i) - pi(i) 
end do 
! The rhs only for phi at the boundaries 
rhs phi(0) = - 0.5d0 « ( phi(2) - 4.0d0«phi(1) + 3.0d0 « phi(0) 
) / dx 
rhs phi(Nx) = - 0.5d0 « ( phi(Nx-2) - 4.0d0*phi(Nx-1) + 3.0d0 x 
phi(Nx) ) / dx 


if (rk.eq.1) then 
psi = psi p + rhs psi « dt 
pi = pi p + rhs pi x» dt 
phi = phi p + rhs phi » dt 
else 
psi = 0.5d0 « ( psi p + psi + rhs psi * dt) 
pi = 0.5dO0 » ( pi p + pi + rhs pi » dt) 
phi = 0.5d0 « ( phi p + phi + rhs phi +» dt) 


end if 
psi(0) = - 0.5d0 « ( phi(2) - 4.0d0«phi(1) + 3.0d0*phi(0)) / dx 
pi(0) = psi(0) 
psi(Nx) = 0.5d0 « ( phi(Nx-2) - 4.0d0*phi (Nx-1) 
+ 3.000 * phi(Nx) ) / dx 
pi(Nx) = -psi (Nx) 
end do 
| ****x* --» Ends Loop Core «-- 


The results are shown in Fig. 4.5, where the wave function $ behaves as we have 


already seen in the previous chapter. New in this case is the behavior of the auxiliary 
variables y and x. The wave function can be compared with the results obtained 
with the simple discretization method in Fig. 3.8 and the Crank-Nicolson method in 
Fig. 3.16. 


Periodic Boundary Conditions. The implementation consists in identifying the 
values of $, V, and7 at the left boundary (xo, t") with those at the right boundary 
(Xy, t"), which produce the effect of topology change of the domain as illustrated 
in Fig.3.5. In practice, one has to specify the appropriate right-hand sides of 
$, V,andz at (xo, t") and (xy,, t"). At the left, boundary equations (4.10) are 


Written as 
Ty — Ty 4 
ay = —— M 4 A y 
iw 2Ax + O(Ax*) 
wi — Wy 
an = —— —*=1 4} (Ax), (4.16) 


2Ax 
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Fig. 4.5 Numerical solution using the MoL for the wave equation with outgoing wave boundary 
conditions. Shown are the wave function @ and the auxiliary variables y and zr 


[UD = T» 


whereas at the right boundary equations (4.10) become 


n 


T, — TN,-1 2 
> x A 
Ow 2Ax + O(Ax^), 
vi VN. 
dec B 14 O(Ax?), (4.17) 
ard = TN, 


For the numerical solution, we define the domain Dg with [Xmin, Xmax] = 
[-1,1], ty = 2, using C = 0.5, and resolution with Ny = 200, equivalent to 
Ax; = 0.01. The results are shown in Fig. 4.6, where we notice that all the variables 
get off through one of the boundaries ((xo, t”) or (xw, , t")) and reenter the domain 
through the other one. These boundary conditions are implemented on the right- 
hand side of the equation for each variable, which is handy. The Loop Core code 
would read as follows: 


| ****x* --> LOOP CORE <-- 
! Recycle arrays 

phi p - phi 

psi p - psi 

pip - pi 
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Fig. 4.6 Numerical solution using MoL for the wave equation with periodic boundary conditions. 
Shown are the wave function $ and the auxiliary variables y and zr. The wave function can be 
compared with that of Fig. 3.6 


! Mid-point RK2 

do rk=1,2 
! Calculate the RHS at the interior 
do i-1,Nx-1 


rhs psi(i) = 0.5d0 + ( pi(i«1) - pi(i-1) ) / dx 
rhs pi(i) = 0.5d0 * ( psi(i+1) - psi(i-1) ) / dx 
rhs phi(i) - pi(i) 
end do 
! RHS for periodic boundary conditions 
rhs psi(0) = 0.5d0 » ( pi(1) - pi(Nx-1) ) / dx 
rhs pi(0) = 0.5d0 « ( psi(1) - psi(Nx-1) ) / dx 
rhs phi(0) - pi(Nx) 
rhs psi(Nx) = 0.5d0 « ( pi(1) - pi(Nx-1) ) / dx 
rhs pi(Nx) = 0.5d0 « ( psi(1) - psi(Nx-1) ) / dx 


if (rk.eq.1) then 
psi = psi p + rhs psi * dt 
pi = pi p + rhs pi x» dt 
phi = phi p + rhs phi * dt 
else 
psi = 0.5d0 « ( psi p + psi + rhs psi +» dt) 
pi = 0.5dO0 » ( pi p + pi + rhs pi « dt) 
phi = 0.5d0 « ( phi p + phi + rhs phi + dt) 
end if 
end do 


! ***** --» Ends Loop Core «-- 
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Fig. 4.7 Snapshots of the solution using periodic boundary conditions in the time domain 
[0,50] and the RK3 integrator, every two units of time using three resolutions with Ny = 
200, 400, and800. At the right bottom, we show the central value of $ as function of time for the 
three runs, which illustrates that diffusion is resolution-dependent. These results are to be compared 
with those in Fig. 3.11 


We finally show the effects of diffusion and dispersion as done in Fig. 3.11, 
this time using the method of lines with the third-order Runge-Kutta integrator in 
Fig. 4.7 and with the second-order Runge-Kutta in Fig. 4.8. In the later case, the 
evolution is unstable after a few crossing times since errors accumulate and trigger 
high-frequency modes that destroy the solution. 

Continuing with the expression of solutions in terms of plane waves whose 
velocities may be different for different modes in Sect. 3.4.3, a summary of effects 
from [1] reads as follows: A scheme is unstable if at least one Fourier mode grows 
without bound in the sense explained in Appendix A, as happens with the results 
using RK2 method in Fig. 4.8. It is dissipative if no Fourier mode grows and at 
least one decays, like in the case of the diffusion equation in Sect. 3.4. It is non- 
dissipative if Fourier modes neither grow or decay, nearly like the simple method 
used to solve the wave equation with results in Fig. 3.11 with high resolution. It is 
dispersive if different modes propagate at different speeds, like the solution of the 
wave equation using the Crank-Nicolson method with C = 2 in Fig. 3.17 or using 
the MoL with the RK3 integrator in Fig. 4.7. 

Finally, the code that solves the wave equation is MoLWave . £90, listed in 
Appendix B. 


170 4 Method of Lines for Initial Value Problems Involving PDEs 


1E 
0.8} N,=400 
0.6} 
= ol 
0.2} 
0 Mer AERA en 
0.25 -0.5 0 0.5 1 


08. N,=800 


o 
m 
(0) 


bur: -0.5 0 0.5 1 


Fig. 4.8 Snapshots of the solution using periodic boundary conditions in the time domain 
[0, 50] and the RK2 integrator, every two units of time using three resolutions with Ny = 
200, 400, and800. At the right bottom, we show the central value of $ as function of time for the 
three runs, which illustrates that diffusion is resolution-dependent. These results are to be compared 
with those in Figs. 3.11 and 4.7 


Exercise. The crossing time is defined as the time it takes a signal to travel 
across the domain; in the case of our wave equation, since the speed is one 
and the domain is two units wide, the crossing time is two units of time. Run 
the code using periodic boundary conditions, and determine the number of 
crossing times at which the amplitude of @ changes by 1%. This will tell 
about the dissipation of the method. 


4.5 Wave Equation in a General 1+1 Minkowski Space-Time: 
Example of Characteristic Analysis 


This is an advanced application in relativistic physics. With this example, we intend 
to illustrate the use of gauge in the solution of relativistic problems. We choose the 
wave equation because it is familiar from previous sections. 
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We now use a sufficiently general description of Minkowski space-time. Let 
us assume that the space-time is described with coordinates (X, f). Then the line 
element of this space-time is given by ds? = —di* + dX? or equivalently ds? = 
guvdx" dx" where g,y are the components of the metric tensor in the Minkowski 
space-time. 

This line element indicates the space-time is foliated with straight lines of 
constant f and constant X, and the coordinates of events are points with coordinates 
(X, f). 

Nevertheless, the space-time is the same despite how it is foliated; it is indepen- 
dent of the coordinates we use to label its points. A more general way to label the 
space-time points using lines other than straight lines of constant time and space 
can be done using a coordinate transformation. For example, instead of foliating 
time with lines of constant time, one can define a time coordinate ft such that 
dt = a(x)dt. The spatial coordinate x can also be defined in coordinates such that 
dx = dx — fidt, where f is a velocity at which the x coordinate displaces. These 
two generalizations for time and space coordinates can be combined to produce very 
general descriptions of the space-time. 

Within this general description, the curves of constant space and time coordinates 
are not necessarily horizontal and vertical straight lines anymore. Illustrations of 
various foliations appear in Fig. 4.9. First we show the standard foliation with a = 
1, B = Ocorresponding to horizontal and vertical lines in the space-time. A second 
case uses a nontrivial a = i tanh(10x) + ; with 6 = 0. A third case uses a trivial 
a = | and a constant 8 = 1/2. Finally, a fourth case uses æ = 1 and a nonconstant 
velocity B = x. 

Notice that events corresponding to a given value of coordinate time f lie along 
continuous lines and events corresponding to a constant coordinate position X are 
located along dashed lines. The most common case corresponds to œ = 1 and £ = 0, 
with t — f and X — x, where lines of constant time are horizontal and those of 
constant position are vertical. 

We present one case where lines of constant time are not straight lines and 
another case where lines of constant position are not straight lines either. We will 
illustrate in this section the utility of using these coordinates. 

In relativistic problems, the use of such kind of general coordinates allows the 
control of the evolution in terms of space and time. For example, in the second 
case of Fig. 4.9, the evolution of a process at the left half of the domain will be 
slower than in the right half, whereas in the third plot the spatial coordinate moves 
at constant velocity at all times. 

Therefore, the election of functions œ and 6 depends on the type of process we 
would like to study or the type of effect one wants to capture in the solution. In these 
very general coordinates, the line element ds?, which is invariant under coordinate 
changes, reads 


ds? = —di? + dx? 
= (-a? + B*)dt? + 2Bdtdx + dx?. 
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Fig. 4.9 Four different foliations of the space-time. Lines of constant time are represented by 
continuous lines, whereas dashed lines indicate lines of constant position 


= guvdx” dx", (4.18) 


where x^ = t,x and Einstein summation convention holds. Explicitly, the metric 
tensor and its inverse in matrix form are 


2 2 

s = (f Ml (4.19) 
» (-Mo Bba 

dim ( Bio? A a) dis 


where œ > 0 is called the lapse function and £ the shift vector, with only one 
component for the case of the 1+1 space-time. 

Now, let us focus on the wave equation. The wave D’ Alembertian operator in a 
general space-time is defined by Lid = J uly 78g” 9,4] where g = det(gyv) 
and Einstein summation convention holds. For the metric (4.19), one has /—$ = a, 
and the wave equation for this general description of the space-time reads 
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0=O¢ 
1 


= —— I [V 28" " 8, 


1 1 
— alag” 0,9] + — arlag” 0,4] 
o o 


1 1 f 
PL [ag 8,9 + ug" 9,9] + za [ag db + ag 8,4] 


2 
"dl la + Aad] + La [ae ta (1 f ) ao]. (4.21) 
a a a a 


a a? 


Notice that when o = 1 y £ = 0, one recovers the usual wave equation 76 — 029 = 
0, which holds only in the traditional description of Minkowski space-time. It is 
desirable to write down this equation as a system of first-order PDEs, which would 
allow us to use the method of lines for the construction of numerical solutions. 

Expression (4.21) suggests the definition of new variables y :— 0y$ and 
7 :— (drp — Bdx)/a. Observe that x is simply the argument of the first-order 
time derivative in (4.21). With these new variables, one can write the wave equation 
as a system of two first-order equations, one for zr: 


Ow = dx(ap + pr), (4.22) 


and by assuming ¢ is at least of class C?, the evolution equation for y is 9j. = 
0, (049) = 0, (Əh), which implies an equation for y: 


dy = O0. (ax + By). (4.23) 


Equations (4.22)-(4.23) constitute the first-order version of the wave equation with 
the constraint y. = 0,4. Finally, we construct the wave function ¢ from the 
definition of x, that is, o = oz + Bw. With all these conventions, the IVP to 
solve reads 


à = à, (ay + Br), 
OW = dlar + By), 


dh = an + By, $ — 6,1) V = Yx, t), n — n (x, 1) 
D = x € [Xmin, Xmax] X t € [0, tf] Domain 
$ (x, 0) = pox), W(x, 0) = vo(x). 

7 (x, 0) = zo(x) Initial Conditions 


P(Xmin, t), (Xmax, D 
V (Xmins t), V Ginaxs t) 


TE (Xmin, t), T (Xmax, f) Boundary Conditions 


(4.24) 
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The IVP will be solved using the MoL on the domain Dg with points (x;, t”) = 
(Xmin + i Ax, nAt), where Ax = (Xmax — Xmin)/ Nx and At = C Ax. Before 
dealing with the implementation of the MoL to solve this IVP, we discuss various 
mathematical aspects of the problem. 


Characteristic Analysis. The characteristic analysis of a system of equations is a 
formal strategy to understand the construction of solutions associated with evolution 
problems and is also useful for various reasons, for example: 


— Insome cases, like the wave equation, it allows to write down the system in (4.24) 
as a set of advection equations. 

— The variables obeying these advection equations are the characteristic vari- 
ables. These variables correspond to the modes that carry the information of 
the wave to the right and to the left. 

— These characteristic variables allow the construction of boundary conditions, 
even in general conditions like in our case of the wave equation here fora = a(x) 
y B= B(x). 

— In general, for IVPs associated with less known equations, the analysis allows to 
determine the well posedness of the problem and stability of the solutions. 

— The analysis is essential in the solution of hydrodynamics equations. 


Let us then proceed to the analysis of the wave equation in (4.24). Notice that the 
third equation is only auxiliary for the construction of $ and that the wave equation 
was actually converted into two equations, one for x (4.22) and one for y (4.23). 
Then the analysis centers on these two equations. 

We define a state vector u = (x, Y), so that the system of equations can be 
written as 


3u + 0, (Au) = 0 => 
3u + Að u = —0,(A)u (4.25) 
where 
a--(f5). (4.26) 
a p 


The characteristic velocities of propagation of signals in the xt plane are the 
eigenvalues of the matrix A, which are solutions of the equation det(A — /24) = 0 
with A a local velocity of propagation of data in time. The eigenvalues of A are 


At = — a. (4.27) 


This means that the propagation velocities depend on the coordinates used to foliate 
the space-time represented by the gauge functions o and £. Notice from (4.21) that œ 
has to be nonzero, which implies that the two eigenvalues are real and different; thus, 
the eigenvectors of A constitute a complete set, and then the system of equations is 


4.5 Wave Equation in a General 1+1 Minkowski Space-Time: Example of... 175 


strongly hyperbolic, which is a property that guarantees that the IVP is well posed 
(see, for example, [2] for a detailed discussion of well-posed IVPs). 

In the case 8 = 0 ya = 1, the characteristic velocities are A = +1, constant in 
the whole space-time, which implies the trajectories of the initial data are straight 
lines with slopes +1 in the space-time, that define the light cones x = xo + t with 
xo € R, whose lines correspond to the characteristics of the solution, that is, those 
curves along which the value of the solution is the same as at initial time [3]. An 
illustration of this fact appears in Fig. 4.5; notice that at initial time there are 
initial superposed pulses of $, y, x that separate and propagate along the straight 
lines with slope +1; these lines are the characteristic lines. 

The eigenvectors associated with A+ are u; = (1, —1)T yu = (1, D? then the 
matrix that diagonalizes A is 


Jf dd a df1-1 
P-( 11) P -s( i): (4.28) 


From here, A can be written as A = PAP™! with A = diag(A4, A_). Multiplying 
(4.25) by P~!, one obtains 


P-!d,u+ P^! A9,u = —9, (P^! A)u, 
dw + A0, w = —0,;(A)w, (4.29) 


where we have used that P has constant entries and that P^! A = A P^! . Notice the 


new state vector 
= lím—wy R 
-Pu-- = ; 4.30 
B a. «2 


whose components are the characteristic variables R and L. In this way, Eqs. (4.22) 
and (4.23) decouple, and the dynamics of the wave is described by a mode traveling 
to the right R = iG — y) and another mode traveling to the left L = iG T y). 


Characteristic analysis has translated the system (4.22)-(4.23) into two decou- 
pled advection equations for R and L, with sources on the right-hand side: 
ðR + A0, R = —0,(A4)R, 
dL + A-04L = —04 0. )L, (4.31) 


equations that in principle are easy to solve as done in Sect. 4.3. 


Boundary Conditions 
We discuss the implementation of boundary conditions in detail because the 
implementation is subtle for a general description of Minkowski space-time. 
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Periodic boundary conditions can be implemented as in the previous examples, 

whereas outgoing wave boundary conditions are more complex, and their imple- 
mentation uses the characteristic information of the system of equations developed 
above and are very important. We focus on these conditions only. 
In the case a = 1, B = 0, we know the wave operator [ ] can be easily factorized 
= (0; + 04) (0; — 0,), and as seen before, this property allows to impose outgoing 
wave boundary conditions by setting (9; — 04) = 0 at the left boundary (xo, t") 
and (0; + 04) = 0 at the right boundary (xy, , t”), as done in Sects. 3.2 and 3.3. 

However, for more general œ and f, the operator in (4.21) cannot be easily 
factorized. This is where the characteristic structure of the system is helpful again. 

In terms of the characteristic variables (R, L), the boundary conditions are as 
follows: At the left boundary (xo, t"), we would like L to remain moving toward 
the left, whereas we do not want information traveling to the right, which means we 
need to set R = O there, that is, Ro = 0. At the right boundary (xy, , t"), we want 
the mode moving to the right to move freely, whereas we want to avoid information 
moving to the left, for which we set L = 0 there, that is, Ly, = 0. Notice that since 
R= iG — V) and L = iG + V^), these are exactly the same conditions, 7 = v at 
the left and m = — v at the right boundaries, for the simple case a = 1 and 8 = 0 
as described in (4.14) and (4.15). The difference here is just that now z has a more 
complex definition. 

One can choose to solve the system of equations in (4.24) or the system (4.31) 
plus the evolution equation for $ in (4.24). In this case, the semi-discrete version of 
these equations at the interior points of Dg reads 


Rig — Ri-1 A441 — Axi-1 


0, R = À i Ri, 
: e 2Ax 2Ax . 
Lia) — Lj A j41 — Ài 
a,L — i i41 i—l "ESI st LT 
: 2Ax 2Ax 
dp = aj; + BivVi. 


At the left boundary (xo, t”), the semi-discrete equations are 


— R + 4Rı —3Ro —AÀ4,2 +44,1 — 344,0 


0; R = —À Ro, 
: T9 2Ax 2Ax " 
—L AL; —3L —À 4à—1—3À 
L=) 0 2 +4Lı 0 2+ JI ,0 Lo, 
2Ax 2Ax 
0; = aot + Bowo, (4.32) 


and at the right boundary (xy, , t") 


Ry,-2—4Rn,-1 +3Rn, = At N,—2 — AA, N,-1 + 3A, Ry 


0o, R = —A 
i T 2Ax 2Ax 
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Lw,-2—4Lw,-1-F3Lw, | A-,N,—2 — AA—,N,—-1 + 3A... 
Ne 2Ax 2Ax 


dP = an, Nn, + DN, VN, (4.33) 


=Ly,, 


where we have used the forward (3.7) and backward (3.8) formulas for the spatial 
derivatives. 

Notice that R and L can be integrated up to the boundary points provided values 
for L, R, Ax at the boundaries; however, ¢ can be integrated in the whole spatial 
domain, as long as we know the values of y and x. We know that outgoing wave 
conditions consist in setting Ro = Ly, = 0 as described above. These values should 
enter in expressions (4.32) and (4.33) and imply the following set of algebraic 
equations at the left boundary: 


z (mò +45) = 
=> në = yë = Lo (4.34) 
iq =w) = Ro =0 


which in turn determines the value of $ using the third of Eqs. (4.32). On the other 
hand, at the right boundary, the condition reduces to 


$ (xh, + wR) =Ly, =0 


3 (rh, = VA.) = Rw 


which provides the numbers needed to construct dy, with the help of the third of 
Eqs. (4.33). 

Initial conditions are defined again as a Dirichlet boundary condition at (x, 0) 
and set the same initial data used in the previous examples of the wave equation, 
namely, a time-symmetric Gaussian: 


=> m =—Wh, = RN. (4.35) 


427,2 2x 
po) = Ae ^, Yol) = — = Fol), T(x) = 0, (4.36) 


with A = 1 and ø = 0.1. Finally, for time integration, we use the method of lines 
with the Heun flavor of the RK2 method in Eq. (4.4). 


For the examples below, we define the domain [Xin, Xmax] = [—1, 1], tr = 2 
and its discrete version Dg using N, = 400 cells, which implies a resolution Ax; = 
0.005 and At = CAx with C = 0.1. 

Case 1. We set a = 1 and a constant value of 6 = fo. In this case, the 
characteristic velocities are A, = —1 + fo = dx/dt. The characteristic lines are 
curves whose equations are 
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1 
dt 1 —Bot+1 
T = =N] 7 = : (4.37) 


EBEN 
—po-1 


and determine the characteristic lines followed by the initial data on the space-time, 
which in this case are straight lines. In Fig. 4.10, we show the characteristic lines 
associated with (4.37) and the numerical solution of the IVP in these coordinates, 
for two values of Bp = 0.5 and 1. Continuous characteristic lines correspond to the 
eigenvalue A, and dotted lines correspond to A_. 

For fo = 0.5, the characteristic speeds are A, = 1/2 and A_ = —3/2, which 
implies that the pulse moving to the left will arrive to the boundary (xy, , t”) at 
t ~ 2, whereas the pulse moving to the left arrives at f ~ 2/3 to the boundary 
(xo, t") as can be seen in the plot for the numerical solution of $. 

Now, for Bp = 1, the characteristic velocities are A+. = 0 and A_ = —2, which 
means that the pulse moving to the right will remain frozen during the evolution, 
whereas the pulse moving to the left will arrive to the boundary at t ~ 0.5. 

The stars at initial time of the characteristic lines in Fig. 4.10 illustrate positions 
of some initial conditions on Dg. From these points, the right pulse will move along 


By=1/2 B=! 


A 


Fig. 4.10 At the top, we show a bundle of characteristic lines from (4.37) for fo = 0.5 and Bo = 1. 
The stars at £ = O represent positions of certain points, where the value of the wave function at 
initial time $9 (x) will propagate with constant profile along the characteristic lines. At the bottom, 
we show the numerical solution for $ 
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the continuous characteristic lines, whereas the pulse moving to the left will follow 
the dashed characteristic lines. This idea is complemented in the plots showing the 
numerical solution of $ for the two different values of Bo on Da. 

Case 2. Here, we consider 6 = 0 and a nonconstant lapse a = 1 tanh(10x) 4- i 
which is a smooth version of a step function that brings the lapse from 0.5 for x « 0 
to 1 for x > 0. The characteristics are solutions of the equation 


Bs f m h(10x) + : 
— = = — tan = 
dt E 4 mee a ui 
1 —20x 
-3g IQ 679) +a c C = £( 0) (4.38) 


where C and fo are integration constants. A sample of these characteristics and the 
numerical solution in this case are shown in Fig. 4.11, where the solution ó in this 
gauge is also shown. The characteristics pass continuously from having slope +2 in 
the region x < 0 to + 1 for x > 0. 

The solution reflects this fact: on the left part of the domain (x < 0), time slices 
are separated half the time than at the right part of the domain (x > 0), because the 
lapse o has value ~0.5 for x < 0 and ~1 for x > 0. This is the reason why the 
pulse moving to the left takes nearly twice as long to reach the boundary than the 
pulse moving to the right. 

Case 3. In this case, we use a trivial lapse but a nonconstant shift y = 1 y B = x. 
The characteristics are such that the Gaussian pulses do not reach the boundaries 
because these boundaries move at the characteristic speeds A4 = +1, and therefore 
the wave never reaches the boundaries. The results are shown in Fig. 4.12, where we 
show the characteristic lines, which tend to focus near the boundaries and the pulses 
of @ squeeze but never arrive at the boundary. The pulses of the solution separate 


B=0, o=1/2tanh(10x)+3/4 


-1 (o 1 
X 


Fig. 4.11 Characteristics and solution for Case 2. Characteristic velocities pass from 0.5 for 
X < O0 to +1 for x > 0. Notice that the pulse moving to the left is twice slower than the pulse 
moving to the right, which reflects the fact that in these coordinates the time flows slower in the 
zone where œ ~ 0.5 than in the zone where o ~ 1 
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B=x, o-1 


-1 0 

x 
Fig. 4.12 Characteristics and solution for Case 3 with a = 1 and 8 = x. Notice that near x = 0 
the characteristics have slopes near +1, whereas they tend to focus near the boundaries (x = 


X1,f). Also shown is the numerical solution of ø on Dg, which illustrates how the Gaussian 
pulses squeeze when approaching the boundary 


at initial time and later on, since the coordinates are stretching because 6 = x, 
the Gaussian pulses squeeze in these coordinates, and for this case, we use a high- 
resolution Axı = 0.005 or equivalently Ny = 400 in order to resolve the pulses. 
Finally, because 6 = +1 at the boundaries, the pulses never reach the boundary 
points. 

We use Case 3 to verify self-convergence as indicated in Sect. 3.1. For this, we 
calculate numerical solutions $!, °, and $? using the three resolutions Ax; = 
0.005, Ax2 = 0.0025, and Ax3 = 0.00125 and compare these solutions at the 
snapshot t = 1 shown in Fig. 4.13. On the left, we show the solution for the three 
resolutions where differences among the results are difficult to see. However, in the 
right, we show a zoom centered at one of the pulses. In the zoomed plot, one can 
see the differences. 

According to (3.22), the solution self-converges if the difference between + and 
x points is nearly four times bigger than the difference between x points and circles, 

1 2 
that is, p 
accuracy of spatial stencils and the Heun RK2 used for time integration. 

The formal calculation of the self-convergence factor has to be done at each time 
step along the whole spatial direction, not only at a few points. This requires the 
post-processing of the numerical solutions $!, $?, and $? and the construction of 
the two vectors: 


~ 2? for these few points. This is consistent with the second-order 


$; — 9j, 
à? — 9j, (4.39) 
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Fig. 4.13 Snapshot of the solution of Case 3 at t = 1 using three resolutions. On the left a whole 
domain view and on the right a zoomed plot centered around one of the peaks. The fact that the 
difference between the solution using the coarse and medium resolution is nearly four times the 
difference between the solution using medium and high resolutions, indicates second-order self- 
convergence of the solution at this snapshot 


for i = 0, ..., Ny and all times t”. Then calculate one norm, say the L2 norm of 
these two vectors at each time t”. According to theory in (3.22), the solution self- 
converges if the following result holds: 


Lo(¢} — $7) 
Lo 9? 4.40 
L2(¢? — $3) TM 


for the second-order accurate methods used here. 


Exercise/Challenge. Program a code that reads the output data files for the 
three resolutions used to generate Fig.4.13, define the vectors (4.39), and 
calculate the norms Lall — $2) and L»(9? — p? ) for all n. Finally, calculate 
the left expression in (4.40) as a function of time, and show that the result is a 
curve that oscillates around 4. 


The code that implements this solution is MoLWaveGauge . £90 with the gauge 
and boundary conditions described above. Again, the order of instructions in the 
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implementation is important for which we show the following piece of code: 
|o x**** --> LOOP CORE «-- 


! Recycle arrays 
phi p phi 


! Heun RK2 
do rk-1,2 


! 
d 
rhs phi(i) = alpha(i)*pi(i) + beta(i)*psi(i) 
rhs psi(i) = 0.5d0 * ( alpha(i+1)*pi(i+1) + beta(i+1)*psi(i+1) & 
- alpha(i-1)*pi(i-1) - beta(i-1)*psi(i-1) ) / dx 
rhs pi(i) = 0.5d0 * ( alpha(i+1)*psi(i+1) + beta(i+1)*pi(i+1) & 
- alpha(i-1)*psi(i-1) - beta(i-1)*pi(i-1)) / dx 
rhs R(i) = -lambda plus(i) « 0.5d0 * ( R(i+1) - R(i-1) ) / dx & 
- 0.5d0 * ( lambda plus(i«1) - lambda plus(i-1) ) / dx * R(i) 
rhs L(i) = -lambda minus(i) * 0.5d0 * ( L(i+1) - L(i-1) ) / dx & 
- 0.5d0 * ( lambda minus(i«1) - lambda minus(i-1) ) / dx + L(i) 
end do 
! RHS for outgoing wave boundary conditions at the boundaries 
rhs R(0) = -lambda plus(0) * 0.5d0 * ( -R(2) + 4.0d0« R(1) - 3.0d0«R(0) ) / 
dx & 
- 0.5d0 « ( -lambda plus(2) + 4.0d0«lambda plus(1) - 3.0d0«lambda plus (0 
/ dx * R(0) 
rhs R(Nx) - -lambda plus(Nx) « 0.5dO « ( R(Nx-2) - 4.0d0« R(Nx-1 
3.0d0*R(Nx) ) / dx & 
- 0.5d0 « ( lambda plus(Nx-2) - 4.0d0«1lambda plus (Nx-1) 
+ 3.0d0«lambda plus(Nx) ) / dx * R(Nx) 
rhs L(0) = -lambda minus(0) * 0.5d0 * ( -L(2) + 4.0d0*L(1) - 3.0d0«L(0) ) / 
dx & 
- 0.5d0 « ( -lambda minus(2) «4.0d0«lambda minus (1 
3.0d0*lambda_minus(0) ) / dx * L(0 
rhs L(Nx) = -lambda minus (Nx) « 0.5d0 * ( L(Nx-2) - 4.0d0«L(Nx-1 
3.0d00«L(Nx) ) / dx & 

- 0.5d0 « ( lambda minus (Nx-2) - 4.0d0«xlambda minus (Nx-1) 
3.0d0«lambda minus(Nx) ) / dx » L(Nx) 
rhs phi(0) = alpha(0) «pi(0) + beta(0) *psi(0) 
rhs phi(Nx) = alpha(Nx)«pi(Nx) + beta(Nx)xpsi(Nx) 


+ 


if (rk.eq.1) then 
psi = psi p + rhs psi » dt 
pi = pi p + rhs pi + dt 
phi = phi p + rhs phi + dt 
R= R p + rhs R « dt 
L - Lp + rhs L * dt 
else 
psi = 0.5d0 « ( psi p + psi + rhs psi * dt) 
pi = 0.5d0 x ( pi p + pi + rhs pi « dt) 
phi = 0.5d0 * ( phi p + phi + rhs phi + dt) 
R = 0.5d0 +» ( Rp + R + rhs R « dt) 
L = 0.5d0 + ( L p « L + rhs L +» dt) 
end if 


! Outgoing wave boundary conditions--calculating pi and psi at the boundaries 
R(0) = 0.080 

L(Nx) = 0.0d0 

psi(0) = L(0) 

pi(0) = L(0) 
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psi(Nx) - -R(Nx) 
pi(Nx) = R(Nx) 
end do 
I ***** --> Ends Loop Core «-- 


A final comment is in turn. In this code, we decided to solve all the evolution 
equations, that is, equations for $, v, zt, R, and L, although w and z are only 
used for the implementation of the boundary conditions and only the values of 
To, Wo, TN, and yy, are needed. Thus, one can save allocated memory by avoiding 
the extra calculation of the evolution of these two variables at the inner points of the 
domain and only deal with their values at the boundaries. 


Exercise. In the examples of this section, we have used time-symmetric initial 
conditions. Implement initial conditions for a Gaussian pulse with a finite 
initial velocity to the right. 


4.6 1+1 Schrödinger Equation Using the Method of Lines 


We again solve the IVP defined for the one-dimensional Schródinger equation but 
this time using the method of lines. 

In order to solve it differently, instead of using arrays of complex numbers to 
store the values of the wave function as done in Sect. 3.5, here, we split Schródinger 
equation into two equations, one for its real and one for its imaginary parts. 

Assuming ¥ = W + iU5, the IVP associated with Schrödinger equation iam = 


-1 ay + V(x, t)W reads 


2 
m = -12h + V(x, t)W 
Pee CELO aye rw y = Yi (x,t), V5 = Vo(x,t) 
ðt 2 dx? , dd : 
D = x € [Xmin, Xmax] X t € [0, ty] Domain 


W(x, 0) = V1. o(x), W(x, 0) = V» (x) Initial Conditions 
Vj (Xmin, t), Vi (Xmax, t), Vo Xmin, t), 


V^ (Xmax, t) Boundary Conditions 


(4.41) 
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where V (x, t) is a general potential. In this section, we illustrate the solution for the 
same two cases explored with the implicit methods in Sect. 3.5, namely, the particle 
in a box and the particle subject to a harmonic oscillator potential. 

The numerical solution is constructed this time using the MoL with the RK3 time 
integrator from Eq. (4.5) on the same discrete domain as before, Dg = {(x;, t") = 
(Xmin--i Ax, nAt)}, where i = 0, ..., Nx, Ax = (Xmax —Xmin)/ Nx and At = CAx?. 

The semi-discrete version of the evolution equations in (4.41), needed for the 
implementation of the MoL, reads 


OM, — 1V5,,4 -2Uy t VL FEAT 
at = 2 Ax? [EP El 
OW 14) 2T 
2 E Li+l Li li-l VT, (4.42) 
ari Ax? 


where the second-order accurate formula for the second-order derivative (3.9) has 
been used and the potential at points of the discrete domain Dg is V? = V (xi, t"). 
These formulas are well defined fori = 1, ..., Ny — 1, and the missing equations for 
V4 and U^ at the boundaries will depend on the boundary conditions of the problem 
to solve. 


4.6.1 Particle in a 1D Box 


For comparison, we proceed with the same parameters as in Sect.3.5 for this 
problem. The numerical solution is constructed this time using the MoL with the 
RK3 time integrator on the same discrete domain as in Sect. 3.5. The numerical 
domain Dg is defined with [x,,/5, Xmax] = [0, 1], ? € [0, 10] using Ny = 100 or 
equivalently Ax; = 0.01 as the base resolution, and At = C Ax? where C = 0.125. 

The particle is free in the domain x € (0, 1) and cannot access the rest of IR. 
With this in mind, the continuity conditions on the wave function at the boundaries 
(xo, t^) and (xy,, t") imply Dirichlet conditions ¥(0,t) = W(1,t) = 0. Then 
Eqs. (4.42) are used only at interior points of the domain, and at boundaries, we set 
Wio = Wyy— VT N, = Vy Ny = 0 for all n. 

As initial conditions, we use the exact solution (3.66), V, (x) = 
A/2e- I Ps! sin(nyz x), with ny = 2 att = 0, that is, V4(x,0) = V2sin(27x) 
and W(x, 0) = 0, which translated into the numerical domain becomes 


Vp. = V2sinQzx;), 
Vj. -— 0, 


for the array of the real and imaginary parts of the wave function. 
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Fig. 4.14 Numerical solution for the particle in a box with ny = 2 using the MoL. At the top, 
we show snapshots of Y% and p at various times. This shows the wave function oscillates, whereas 


the density remains stationary. At the bottom, we show that the number of particles N = Jd pdx 
remains nearly constant in time. Finally, we show the convergence of L»(e7) to zero 


Diagnostics of the Solution. The first physical diagnostics consists in showing the 
wave function V = W + iY oscillates, whereas the density of probability o = 
Wey = w? + V2 remains time-independent. This is shown in Fig. 4.14. We also 
show the number of particles N — [^ pdx that has to remain constant in time. The 
value of N in this solution deviates from one only within 107? during the evolution, 
like when using the implicit Crank-Nicolson method in Fig. 3.24. 
Finally, the error of the numerical solution is estimated for the real part of the 
wave function WY at every point (x;, t”) € Da: 
= Zn = vi. (4.43) 
where W° is the exact solution (3.66). In order to show that the numerical solution 
converges, we calculate L2(e?) as function of time for N, = 100, 200, and 400 or 
equivalently resolutions Ax; = 0.01, Ax? = 0.005, and Ax3 = 0.0025. The result 
for L»(e?) appears in Fig. 4.14. Notice that the errors are of the same order as those 
obtained using the implicit Crank-Nicolson method of Sect. 3.5. The reason is that 


the numerical parameters are the same, and the approximations are all second-order 
accurate as well. 
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Exercise. In order to understand why C has to be so small using the MoL, 
it would be interesting to use bigger values of C and find the critical one for 
which the method is unstable. This should be seen as the runaway increase of 
the wave function amplitude. 


Exercise. Use the Heun RK2 method to integrate this problem and discover a 
range of values of C for which the solution remains stable. 


Exercise. Show that Lı (e?) also converges to zero. 


Exercise. At every time-step, calculate the expectation value of the energy 


1 3? em LON 
E 
where n is the quantum number. Verify that it is consistent with the energy 
values E, = (nz)? /2 in Eq. (3.65). For the example of this section, n — 2, 


where E» should have an approximate value of —27:?. The integral can be 
calculated using the formula (3.23). 


4.6.2 Particle in a Harmonic Oscillator Potential 


In this case, the potential is V — 1x? at each point of (xj, t") € Dg takes the values 
V’ = 1x2, i = 0, ..., Ny. This potential is the one to be used in the right-hand sides 
of the semi-discrete system (4.42). 

As initial conditions, we use the exact solution (3.71) at t = O with n, = 3, 
which translated to the arrays for real and imaginary parts of the wave function at 


initial time reads 


1 5 1 2 
0 = =x; /2 j)— 2g Wl "T 3 
M icm " Je ^^ H3 (xi) = NU ü (12x; 8) , (4.44) 


v9. = 0. (4.45) 
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We use the same numerical parameters used to illustrate the implicit method in 
Sect. 3.5. The domain is such that [Xmin, Xmax] = [—10, 10] and t € [0, 10]. For this 
problem, the numerical domain Dg uses Ny = 2000 or equivalently Ax = 0.01. 


Boundary Conditions. In this case, knowing the spatial size of the domain is 
sufficient for the wave function to vanish with a Gaussian profile, Neumann 
boundary conditions are imposed such that the spatial derivative of the wave 
function is zero at (xo, t”) and (xy, , t"). In this case, using the forward (3.3) and 
backward (3.4) discrete formulas of the spatial derivative, these boundary conditions 
reduce to 


V, 2 — 4,14 3V,;9 =O and Wi y.-2 — AV N, 1 + 3I N, = O, 


for k — 1,2, from which one obtains values for the wave function at the boundary 
points 


1 
Vy o = 3 Va — V 2), 


1 
VN, = 3 Gv. 1 m VA N,—2). 
that we implement in the code. 


Diagnostics. The wave function V oscillates, whereas the density of probability 
p-—uw*y- w? + w? remains time-independent. We illustrate the oscillations 
of V4 and time independence of p in Fig. 4.15, so as the number of particles N = 
p p dx, which is nearly constant in time. 

The error of the numerical solution is estimated for Y4 at every point (x;, t") € 
Dg as in Eq. (4.43) with v^ as in (3.71). Finally, in order to show the numer- 
ical solution converges, we calculate L5(e7) as function of time for Ny = 
2000, 4000, and 8000 or equivalently resolutions Ax; = 0.01, Ax? = 0.005, and 
Ax3 = 0.0025. The second-order convergence to zero of L»(e7) is also in Fig. 4.15. 

Finally, the code MoLSchroedinger.f90 solves Schrödinger equation for 
the particle in the box, and the particle in a harmonic oscillator potential is available 
as Electronic Supplementary Material described in Appendix B. 


Exercise. At every time step, calculate the expectation value of the energy 


1 32 Xmax " 182v, x 
JE em Mlle ur cio = v 2 3:2 TVwDw, dx 
X, 


min 


where n is the number of nodes of the wave function. Verify that it is 
consistent with the energy values E, = n + 1 in Eq. (3.71). For the example 
of this section, n = 3, where E3 should have an approximate value of ~ 7/2. 
The integral can be calculated using the formula (3.23). 
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Fig. 4.15 Numerical solution for the particle in a harmonic oscillator potential with n, = 3 using 
the MoL. At the top, we show snapshots of V and the density of probability p at various times. 
This shows that the wave function oscillates, whereas the density remains nearly stationary. At 
the bottom, we show that the number of particles N = f “max Ody remains nearly constant in 


Xmin 


time. Finally, we show the second-order convergence to zero of L2(e’’). These results should be 
compared with those obtained with the implicit method in Fig. 3.26 


4.7 Application: Solution of the Wave Equation on Top of a 
Schwarzschild Black Hole 


We saw in Sect. 4.4 that it is relatively easy to solve the wave equation when the 
gauge functions lapse o and shift 6 are used to describe the background space-time, 
and now we present a case of a non-flat space-time. 

We first write down the line element in terms of gauge functions as follows: For a 
spherically symmetric space-time described with spherical coordinates (r, 0, $, t), 
using the 3 + 1 decomposition, in geometric units G = c = 1, the most general line 
element reads 


ds? = guvdx" dx" 


= (—o? + B, B')di? + 2B,dtdr + y, dr? + yoe(d0? + sin? Odd’), 
(4.46) 
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where all the functions a, 8", y,;, and ygg depend on (r, t). It is convenient to write 
the components of the metric in matrix form and its inverse, because it will be useful 
to write down the wave equation later on 


—o* + BB" By 0 0 
EE By y, 0 0 
E 0 0 ye 0 i 
0 0 0 Yoo sin? 0 


-Mo? Bj 0 0 
B! Jo? y” E EE 0 0 
0 0 yf? 0 
0 0 0 y’? 


g^" = ; (4.47) 


where yj; is the 3-metric of the spatial hypersurfaces, with indices running on spatial 
coordinates only, and satisfies y! b y j= er For metric (4.46), the nonzero entries 
of y are y'" = 1/y,,, y ? = 1/yoo, y"? = 1/(yoo sin? 0). 

Considering that g is the determinant of guv, then /—g = «yy, where y = 
yrr Y sin? 0 is the determinant of the 3-metric yij Of spatial hypersurfaces of the 
space-time. Using this, the wave equation using the D’Alambert operator Lid = 
La, [L/—88^" 3,0] for the general metric (4.46) reads 


J= 
0=O¢ 
1 

= —— ôu [V= gg” day 

JM 88" dv] 


1 = otu = GV 
= x5 (ntes rl + dla vari) 


sing 
= (Ala /y (g" dp + g"8,)] + 8, [o / y (g" 810 + 8" a-p) 


o Jy sin 
oi 1 p 
ETE] 

+9, lav (Sa. + (" - d ) e)]) (4.48) 


where we defined y = y sin? 0, with y = y, Vén- Defining new variables 


x := YY ag -= By), 


Y := 90, 


190 4 Method of Lines for Initial Value Problems Involving PDEs 


the above equation transforms into a first-order system of equations: 
A = 0, C /yay" dp + PT), 


a 
av — 9, ( =r +B"), 
d (env) 


dies T” + fly, (4.49) 


where we added the evolution equation for $, obtained from the definition of zr. 


Now the Black Hole Space-Time. The line element of the Schwarzschild space-time 
written in Eddington-Finkelstein coordinates reads [4, 5] 
2 2M 4M 2M a. 22 2 
ds^——|1-— dt^ + —dtdr + "Loc dr? +r ?(q8 + sin’ 0d$^), 
(4.50) 
where M is the mass of the black hole and (r, 0, $, t) are the coordinates used to 


describe the points of the space-time. 


Exercise. Show that by equating (4.46) and (4.50), one obtains the explicit 
expression for metric and gauge functions: 


1 
a= 
14+ 
en s 
= [ENS 


2M 
fj Vrr B^ = =, 
r 
Yeo = m 
Yop = Yoo sin? 0 = r? sin? 0, (4.51) 


which are needed to specify the system (4.49) for the black hole space-time 
metric. 


Domain. In order to define the domain in which we will solve the wave equation, 
one needs to keep in mind that at r — 0 the Schwarzschild space-time has a gauge 
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invariant singularity to be careful with. On the other hand, it would be helpful to 
investigate the light cone structure of the space-time in order to know where the 
domain might offer problems. 

Due to the symmetry, the light cones defined in this spherically symmetric space- 
time are independent of the angular coordinates (0, $) and are determined by the 
curves in the tr —plane that satisfy the condition 


" 2M\ > 4M 2M\ > 
ds? =0 =—(1- — Ja? + —dtdr + (1+ — Ja? > 
r r 


r 
2M\ (dt N? 4M (dt 2M 
0= 1 + tí1-—]20 > 
r dr r dr r 
2M-r __ —1 
dt r—2M ~ 
— = (4.52) 
dr r42M 
r—2M 


whose integration gives an expression for the null trajectories that define light cones: 
t—to=-r-+ro, 


r—2M 
t — to = 4M ln | ——— — ro, 4.53 
0 a(t ro (4.53) 


that describe, respectively, the ingoing and outgoing null geodesics along the radial 
direction, where tọ and ro are integration constants. This expression allows one to 
construct the light cone structure shown in Fig. 4.16, described with the ingoing and 
outgoing null geodesics along the radial direction valid for all (0, $). Notice first 
that one of the properties of Eddington-Finkelstein coordinates is that the ingoing 
null geodesics have slope —1, whereas the outgoing rays pass from having a slope 
near +1 for large r to infinite slope exactly at r = 2M and negative slope for 0 < 
r « 2M. 

The event horizon is located at r — 2M and notice that light cones are open 
there. For illustration, there is a pair of bold null rays that cross at the point (2, 8) M. 
There, the outgoing null ray of the cone is vertical, which means that a photon will 
remain over this surface forever, whereas the ingoing null ray of the cone has slope 
— |. This means that the world lines of test particles passing through this cone will 
move inevitably toward r < 2M inside the horizon. 

Figure 4.17 illustrates the light cone structure of the space-time when using EF 
coordinates and how world lines of test particles near the horizon move within light 
cones and can cross the horizon. For comparison, we also show the cone structure 
when describing the space-time with Schwarzschild coordinates and illustrate how 
the light cones are closed near the horizon which prevents particles to cross the 
horizon. That light cones are open at the horizon is a convenient property if 
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Fig. 4.16 Null rays that 10 
define the light cone structure 
of the Schwarzschild black 
hole space-time in 
Eddington-Finkelstein (EF) : 
coordinates. The outgoing 6L ^ 
null ray at r = 2M indicates i 
the location of the event 


UM 


horizon, because it is the 

boundary between rays that ; 
can escape toward future null 2.^ 
infinity and those that cannot 
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Fig. 4.17 Left: light cone structure of the Schwarzschild space-time in EF coordinates. Right: for 
comparison, we show the light cone structure when the Schwarzschild space-time is described with 
Schwarzschild coordinates out of the horizon 


one wants to simulate the accretion of matter toward the interior of the hole. 
Schwarzschild coordinates do not have this property; in that case, both ingoing and 
outgoing null rays have infinite slope at r — 2M, which makes Schwarzschild 
coordinates inappropriate to describe particles that cross the horizon. Then it 
is said that Eddington-Finkelstein are horizon-penetrating coordinates, whereas 
Schwarzschild coordinates are not. 

The wave equation can be solved in a spatial domain that will allow to see how a 
black hole accretes the wave. Nevertheless, due to the singularity at r = 0, it is not 
possible to use a domain that contains the origin. What is done is to choose a spatial 
domain r € [rmin, max] with O < rmin < 2M, a method called excision, because 
actually a sphere of radius rjj; is being excised from the space at all times. 

An important condition is that the space-time background is fixed and thus the 
metric and gauge functions «œ, 8", yr, Yea, and ,/y are all functions of r only and 
do not evolve in time. 
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It is now time to formulate the IVP for the evolution of a wave on top of a 
Schwarzschild black hole: 


a, = 0, ( / yay" y + Bm) 
aw = ð, (r " ev) 


ap = on + BY. = $0.0), 
w=v,t), mz =7(7,1) 

D = r € [rmin. Tmax] X t € [0, tf] Domain 

$ (r. 0) = $o(r), v(r.O) = vo(r), x(r, 0) = xo(r) Initial Conditions 

(mint), (Fmax, t) 

V (mins 0), Ymax, t) 


(min, t), T (Fax; t) Boundary Conditions 
(4.54) 


Evolution. For the evolution, we need to define the right-hand side of the equations 
in (4.54) using the gauge and metric functions in (4.51), from which one can 
explicitly write down the following needed factors: 


| 2M 
i= tar le > 
a 1 


C Remy 


r2 


rr 
Jyay = , 
14+% 
which are regular within the numerical domain with excision. 
In all the examples, we set M = 1, in which, combined with the geometric units 
G = c = 1, time and space are in units of M, the mass of the black hole. Reference 


[6] contains a detailed conversion from geometric to physical units. 


Initial Conditions. We use Dirichlet boundary conditions at the side (r, 0) of the 
domain: 


cos(kr) g ome? 
r 


por) =A 
Vo(r) = 0-do(r), 
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mol) = -Y* g uy) (4.55) 


corresponding to a spherical shell with Gaussian envelope and wave number k. In 
the example below, we use A = 1, ry = 20, o = 2, and two values of k. 


Domain. We set the inner boundary at rj, = 1 in order to allow the wave to 
enter the horizon at r = 2 and travel within the hole, and the external boundary 
at Fmax = 51, which is sufficiently far from the horizon. We define the numerical 
domain as Dg = ((ri, t")) with ri = rmin + iAr, i = 0,1,2,..., Np, t" = nAt, 
where Ar = (Fmax — rmin)/ N, and At = C Ar are space and time resolutions. We 
use the base resolution N, = 5000 or equivalently Ar = 0.01 and C = 0.1. 


Boundary Conditions. The inner boundary (7min, t) with rmin = 1 < 2 lies within 
the horizon, and according to Fig. 4.16, ingoing and outgoing null rays point toward 
the origin, and in principle no information will come out from there. We only need 
to make sure the equations at the boundary r = Fmin are correctly implemented. 
The equation for ¢ in (4.54) does not involve any spatial derivatives, whereas the 
equations for m and y involve a radial derivative. Then one needs to use one- 
sided stencils to calculate such derivatives. Explicitly, using the expression (3.7), 
the evolution equations at ry = rjj; read 


eae + BT) |rar, — AG /vay v + B'n)lrn | 
T3Q/yay"' v + B'z)|rr 


9,7 |, y = Ap + O(Ar?), 
(fn + ev) "S (Jon ee) -" 
= (57 ‘i py) r=ro 2 
Or |, —rg = AAr t O(Ar^, 


8rd lr = (= F 2) (4.56) 


Nid 


At the outer boundary (Fmax, t), it is possible to implement an outgoing 
wave boundary condition. This needs the characteristic structure of the system of 
equations at Fmax = ry,. If u = (Gr, y), the system for z and y can be written as 


r=ro 


3u +3 (Au) —0, with A=- ( E ed ) f (4.57) 
a B 
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where A has constant entries as long as the metric functions are evaluated only at 
r — ry,. The eigenvalues and eigenvectors of A are 


Apcecd d yr E. ues 4 D u = (~ 7 e (458) 


m -1 1 


The matrix P = (u,,u..) diagonalizes A, where A = P^ AP is the equivalent 
diagonal matrix. Multiplying Eq. (4.57) by P7! from the left and using that P^! A = 
AP: 
3u + 0, (Au) = 0|, —., 
0;u + Ad-u = 0|, —., 
P'(Qu-P'AQu-O|]., > 
94,(P w-P'A$u-O0Lo,, > 
àáw-A39,Pu-0Lo., > 
drw + Að, w = Olr=ry,- (4.59) 


This means that the equations for m and y decouple and become a system of 
advection equations for the entries of the new state vector w = P~!u, namely, for 
the right and left modes: 


aper pi(vwm ¥ -(*) 
w=P u=P (2-302) Ll (4.60) 


For the Eddington-Finkelstein metric, from (4.51), vy = r?°, and thus 
VVV" |r2ry, = PA We are only interested in the values of the characteristic modes 
at the boundary Ry, and Ly, , not necessarily in the whole domain. 

The outgoing wave boundary condition at the outer boundary means that L — 0 
atr — ry, because we do not want information reflected back from the boundary. 
This implies that the values of r and y at this boundary satisfy the expressions 


EM 
A — Yn, =2Ry, TN, = Ty, RN, 
XN, m — (4.61) 
Bot V cud M VN, =— 3, 
Nr 


and all we need is to know Ry, in order to calculate the values of zy, and wy,. 
This can be done with Lagrange extrapolation (for a simple formula, see [7]), of the 
values of R from the interior neighboring points as follows: 


Ry, = 3Ry,-1 — 3Rw,-2 + Rn, -3, (4.62) 
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Fig. 4.18 Evolution of $ for k = 0 and k = 4 on Dg 


which can be calculated using the definition (4.60) for values of R at points 
Ry,—1, Ry,-2, and Ry,-3. 

The numerical solution is shown in Fig. 4.18 for the wave function $ using two 
wave numbers k — 0 and k — 4. The initial pulse splits into ingoing and outgoing 
pulses. The two boundaries absorb the pulse after a finite time. One pulse of the wave 
function is absorbed by the black hole, and another one escapes toward infinity. 

The code MoLEFWave . £90, solves this problem using the third-order Runge- 
Kutta integrator and is available as Electronic Supplementary Material described in 
Appendix B. 


Exercise/Challenge. It is possible to modify the code above and construct 
solutions to the Klein-Gordon equation [1$ 4-im?$ = 0 for a scalar field on top 
of a black hole. The auxiliary variables and boundary conditions are exactly 
the same as those constructed here, and it would require only to calculate the 
appropriate right-hand sides of the evolution equation for the variable zr. 


4.8 Application: Thermal Diffusion of Earth's Crust 


We expand the applicability of diffusion equation in Sect. 3.4 to a more general case 
with space-dependent diffusion coefficient and a source, the Reaction-Diffusion 
equation. The application consists in describing the thermal history of Earth's crust. 
The problem setup is based on the specifications described in reference [8], where a 
model of the crust temperature from Earth's surface until 130 km under is modeled 
with the equation: 


, (4.63) 


oT 0 oT Arad + As 
= K 
ot Oz Oz pCp 
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where T = T(z, t) is the temperature as function of time and depth z. The thermal 
diffusivity « is assumed to be space-dependent, A,44 is a heat source due to the 
radiation projected on the surface, and A, represents the contribution of strain 
heating due to shear stress between shells at z — 35 km. 

The phenomenological functional model for « as function of T in terms of 
observations described in [8] is 


567.37 ! — 0.062, T < 846K 
k= (4.64) 
0.732 — 0.000135T, T > 846K 
where « has units of mimt and T in Kelvin. Also, a phenomenological model of 
specific heat capacity based on empirical evidence is used in the model, resulting in 
the following formula [8]: 


199.5 + 0.0857 T — 5 x 106 T2, T < 846K 
Cp = (4.65) 
229.32 + 0.0323 T — 47.9 x 107 T7?, T > 846K 


J 
mol K’ 


where Cp has units of where the molar mass is 221.78 g mol! and T is in 
Kelvin. 

The model used for A;gg is such that Arad = 2 x 10-95Wm^? at the Earth's 
surface and then drops exponentially until 35 km. Between 35 and 70 km of depth, 
Arad = 0.2 x 10 Wm ? and finally between 70 and 130km, A,ad = 0.02 x 


107-6Wm-^?. This model can be summarized as follows: 
2310 84 9 Win? O27 < 35 km 
Arad = $ 0.2 x 1079 Wm ^, 35 < z < 70 km (4.66) 
0.02 x 1076 Wm ?, 70 < z < 130 km 


The strain heating source A, is given by Ås = rv/ó, where t = 30 MPa is the shear 
stress, v = 3cm yr”! is the thrusting velocity, and ô is a characteristic width of the 
shear zone, modulated by a Gaussian, that is, A; — Á,e- C35 IP. 

Finally, the crust density is assumed to be constant in the whole domain p = 


2700kg/m? and that the average molar mass of the crust is given by 221.78, 
which is equivalent to 0.22178 Š$.. 


Units. Notice that different parameters and quantities use different units. In order to 
solve the equation, we find appropriate to standardize to units of length in kilometers 
(km), of time in kiloyears (kyr) and temperature in Kelvin (K), and all parameters 
are to be transformed accordingly. The terms in Eq. (4.63) in (kyr, km, K) units are 
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mm? 2 | km? 
K = 3.1536 x 10 *« | —— (4.67) 
S kyr 
Arad |. ÀAxXIOSLE] — A x 1078 E 
pCe  27x10[S9]Cp[nlg] 27x 10°Cp L s-kg 
2.2178 x 3.1536 A [ K 
E x (4.68) 
2.7 Cp | kyr 
Lo 26-35? 
A;—A,e 9* 
7 3 x 10/[S [spem] 9 
A, == = E 10-5 (4.69) 
5 [km] 3.1536. ô 
As ES x 107 5p] | (c-35? 
= k e 282 
OCP 27 x 09[-$]Cp[ s 
_@ 35? K 
= 73. e ls (4.70) 
ô c kyr 


where we used the conversion factor for units of time Ikyr = 3.1536 x 10!°s. 

The problem is solved in the domain z € [0, 135]km during a time window of 
40 million years (Myr). We describe the domain D = [Zmin, Zmax] x [0, tf] with 
Zmin = 9, Zmax = 135 km, and tf = 40Myr. The discrete domain Dg is the set of 
points (z;, t") where z; = i Az with Az = 135/N, where N; + 1 is the number of 
points along the spatial direction and t” = n At with At = CFLAz?. 

The value of the various functions (4.67)-(4.70) involved in the equation at point 
(zi, t”) are ki, CPi, Arad,i, and As j, since x and Cp are functions of z implicitly 
through the functional dependence on T in (4.64) and (4.65), whereas the sources 
Arad and A; are explicitly space-dependent. Ready for integration, the semi-discrete 
version of the evolution equation for T (4.63) at point (z;, t”), suitable for the 
method of lines, is: 


oT u T^ = 2T” + +T} + 1 Ki+1 — Ki-1 Tha T^i FS A rad,i st Asi 
Ot lezit) 4z? 4 Az Az piCpi ` 
(4.71) 


At boundary points i = 0 and i = N;, time-independent Dirichlet boundary 
conditions are set to T (zo = 0 km) = 290K and at T (zy, = 130km) = 1300C = 
1573.15K. The one at z = 0 is motivated by a time-independent average surface 
temperature, whereas the one at z = 130 km is motivated by the heat transfer by 
convection that keeps the temperature stationary at that depth. 


Initial Conditions. There is no prescription for initial conditions in [8], although 
diffusion and source terms are expected to drive the evolution of T. Then, as initial 
condition, we use the line 
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Fig. 4.19 Temperature of the crust as function of depth z at 10, 20, 30, and 40 Myr, although we 


z 
ax | and 


only indicate the 10- and the 40-Myr geotherms. At the left, the case of constant « = 1 | 
at the right « as given by the empirical expression (4.64). This example uses 6 = 1.5 km 


T (130, 0) — T(0, 0) 1573.15 — 290 
T(z,0) = T(0,0 = 29004 eere 
= d One 130 E ix 130 E 


which is used to start the evolution. 

The discrete domain is defined with N, = 1300 cells or equivalently spatial 
resolution Az = 0.1km, whereas time resolution is At = 0.25Az? = 2.5yr. 
The evolution of temperature with these parameters for 6 = 1.5 km is shown in 
Fig. 4.19, with plots every 10 million years. The strain heating at 35 km distorts the 
profile, whereas diffusion pushes geotherms to the right. These results illustrate how 
temperature grows in time in the scale of millions of years. Finally, this plot can be 
compared with Figure 3 of reference [8]. 

The code EarthCrust.f90 that serves to solve this problem is available as 
Electronic Supplementary Material described in Appendix B. 


4.9 How to Improve the Methods in This Chapter 


The methods in the chapter can be improved in at least two ways: The first one 
is the time integration, for which a number of ODE solvers can be used, both 
explicit, implicit, or mixed implicit-explicit, each with different dissipation and 
stability properties that may depend on the equations to be solved. The second one 
is the accuracy of the discretization of spatial derivative operators, which can easily 
improve from second to fourth or sixth order, operators that can be constructed with 
the ideas of Sect. 3.1. 
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4.10 Projects 


With the methods described in this chapter, it is possible to carry out the following 
projects: 


4.10.1 Solution of the Wave Equation in the Whole Space-Time 


It is possible to construct solutions of the 1 + 1 wave equation in the whole space- 
time. For this, one has to compactify the space-time into a finite numerical domain. 
There are various ways to compactify the space-time, for example, by redefining the 
spatial coordinate as X — i — that brings the spatial infinity too to +1. 

In the case of the wave equation, which travels at the speed of light, the boundary 
is at future null infinity, or ,7 * , and a foliation using constant mean curvature spatial 
slices compactifies 7*. In order to know what this means, in Fig. 4.20, we show 
the Penrose diagrams of some particular examples of this compactification, and 
in Fig. 4.21, we show the resulting light cone structure of the space-time in these 
compactified coordinates. 

The project consists in solving the wave equation in coordinates of this type 
following the detailed description in [9]. Further projects can include the solution 
of the spherically symmetric wave equation in the 3 -- 1 Minkowski space-time 
that reduces to a 1 + 1 IVP and in fact the solution of the wave equation on top 
of a Schwarzschild black hole using compactified versions of the space-time. The 
technical information and the required details can be found in the academic paper 


[9]. 


Fig. 4.20 Penrose diagrams of two different foliations that compactify future null infinity of the 
1 + 1 Minkowski space-time 
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Fig. 4.21 Light cone structure of the two foliations in the previous figure, which compactify future 
null infinity of the 1 + 1 Minkowski space-time 


4.10.2 Nonlinear Absorption of a Scalar Field 


In Sect. 4.7, we described the methods to solve the wave equation with spherical 
symmetry, on top of a Schwarzschild black hole. This problem can be generalized 
and consider also the evolution of the space-time coupled to the evolution of the 
Klein-Gordon field from the equation in the challenge above [1o + m? = 0. 

Scalar field and Einstein field equations can be defined as an IVP for the field 
and the geometry. A simple method to solve Klein-Gordon equation coupled to a 
spherically symmetric space-time is found in [10]. The additional work consists in 
the implementation of the solution of Einstein equations, which are written in terms 
of the 3+1 decomposition of space-time, using the ADM formulation [4, 5]. Then, 
evolution equations for the components of the 3-metric of space-like hypersurfaces 
used to foliate the space-time and the components of their extrinsic curvature are 
coupled to the evolution of the scalar field [10]. 

Interesting diagnostics appears in this case, because it is possible to track the 
growth of the black hole horizon caused by the accretion of ø. Methods for the 
evolution and diagnostics are detailed in [10]. 


4.10.3 Black Hole Shrinking 


The evolution of the space-time in the previous project can be improved by using the 
GBSSN formulation of Einstein equations instead of the ADM formulation [4, 5]. 

The idea here is to, additional to the change of formulation, evolve a scalar field 
with negative energy density and show that the black hole horizon shrinks. The 
equations to be solved are described in reference [11], and the methods for the 
evolution of the scalar field and space-time geometry are those described in this 
chapter. 
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4.10.4 Bose Condensates in Optical Lattices 


The dynamics of a dilute Bose Gas at very low temperatures can be described by the 
Gross-Pitaevskii equation, which mathematically is Schródinger equation with the 
nonlinear contribution |W Pw, and has a macroscopic, collective interpretation. The 
nonlinear term models the interaction between atoms and is related to the number 
of condensed particles. 

Considering that we have solved problems with periodic boundary conditions, an 
application of Schródinger equation consists in the simulation of the evolution of a 
Bose Condensate on a lattice, modeled with a repulsive, periodic potential [12]. The 
equation to be solved is 


E19 costa + Chou 
1—————— cos(x : 
at 2ax2' °° 


The project consists in calculating the current of the condensate as function of time 
in terms of the number of condensed atoms, a number encrypted in the constant C. 
Other phenomena like Bloch oscillations or transport blocking can also be studied 
[13]. The details needed to follow this analysis can be found in [14]. 
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Chapter 5 A 
Finite Volume Methods ga 


Abstract We use Burgers equation to illustrate how the methods based on finite 
difference approximations fail to resolve IVP involving quasilinear PDEs. We then 
move straightforwardly toward the solution of Euler equations in 1 + 1 dimensions, 
using a simple combination of the elements composing the finite volume approach, 
namely, simple variable reconstructors and the HLLE flux formula. We invest efforts 
in the construction of the HLLE formula and the characteristic structure of systems 
of equations first seen when solving the generalized wave equation. We illustrate the 
use of the method with the simulation of the formation of the stationary solar wind 
assuming spherical symmetry. We also show the power and need of the method in 
relativistic physics by solving the relativistic Euler equations in 1 + 1 dimensions 
and with the problem of the accretion of a perfect fluid onto a Schwarzschild black 
hole. 


Keywords Partial Differential Equations - Finite volumes - Hydrodynamics 


We use Burgers equation to illustrate how the methods based on finite difference 
approximations fail to resolve IVP involving quasilinear PDEs. We then move 
straightforwardly toward the solution of Euler equations in 1+ 1 dimensions, using a 
simple combination of the elements composing the finite volume approach, namely, 
simple variable reconstructors and the HLLE flux formula. We invest efforts in the 
construction of the HLLE formula and the characteristic structure of systems of 
equations first seen when solving the generalized wave equation. We illustrate the 
use of the method with the simulation of the formation of the stationary solar wind 
assuming spherical symmetry. We also show the power and need of the method in 
relativistic physics by solving the relativistic Euler equations in 1 + 1 dimensions 
and with the problem of the accretion of a perfect fluid onto a Schwarzschild black 
hole. 
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5.1 Characteristics in Systems of Equations 


Consider the IVP associated with the advection equation: 


ð f] 

Z ie: u= u(x,t) 

ot Ox 

D = x €(—w,00o) x t>0 Domain (5.1) 
u(x, 0) = uo(x) Initial Conditions 

U(Xmin, t), U(Xmax, f) Boundary Conditions 


We know from Sect. 4.3 that a is the velocity of propagation of the initial data u(x). 
This example is used to construct the characteristic curves, that is, curves along 
which the initial data propagate without change. Notice that the domain of the IVP 
is such that boundaries will not affect the development of initial data. 

Calculation of the total derivative of u with respect to time gives 


du ðu ðu dx 


dt at | Ox dt’ 


that equals zero for dx/dt = a according to (5.1). This restriction implies that 
x = xo + at and that the initial conditions at point xo will remain constant along the 
curve x = xo + at. The value of u along this line will be the same within the whole 
domain D shifted along the spatial coordinate. Thus, for every xo at initial time, the 
solution to the equation in (5.1) will be given in terms of the initial conditions uo(x) 
as 


u(x, t) = uo(x — at), (5.2) 
which can be verified by direct substitution into the advection Eq. (5.1). 


Now, let us consider an IVP associated with the following system of equations 
similar but more general than the advection equation: 


M (x,t 88 oF t )=0 (5.3) 

at “i X,Í, Ul, ..., Um ax j(\%,0,U],...,Um) = M, E 
j- 

fori = l,...,n. This is a system with n equations and n unknowns that depend on 


x and f, which can be written as 


à à 
wta()+b=0 (5.4) 
X 
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where 
uy 411 d12 ... Ain bi 
u2 42| 422 ... Q2n b2 
u=| . |, A=] . . |. b=]. I. (5.5) 
Un Ani an2 ... Ann bn 


In the particular case of constant entries a;; and bj, this system is linear with 
constant coefficients. 

If aij = aij(x,t) and bj = bj(x,t), the system is linear with variable 
coefficients. 

If the entries of A depend on u, that is, A = A(u), the system is quasilinear 
because it may contain products between the variables u; and their first-order spatial 
derivatives ðu ;/dx. 

There are various degrees of hyperbolicity of a system, which are important 
from the mathematical point of view. The system is called weakly hyperbolic if 
the eigenvalues of A are real, strongly hyperbolic if the eigenvalues of A are real 
and it has a complete set of eigenvectors, strictly hyperbolic is the eigenvalues are 
real and distinct, and symmetric hyperbolic if A is Hermitian. So far, what we need 
for now is to know that eigenvalues represent speeds of information at each point 
of the domain and that they will be helpful to describe the Finite Volume method. 
On more formal matters, the degree of hyperbolicity of the system of equations is of 
great importance to determine whether an IVP is well posed. Recommended reading 
on this subject is [1, 2]. 


Exercise. Determine the type of hyperbolicity of the first order system (4.25)— 
(4.27), developed for the wave equation. 


5.1.1 Constant Coefficient Case 


Let us consider the homogenous case b = 0 and that the system is strongly hyper- 
bolic. Assume the entries of the matrix A are all constant, which has eigenvalues 
À1,..., Àn, and a set of linearly independent eigenvectors rj,...,.r;. Then the 
system can be split into a set of n advection equations as follows, provided A 
can be diagonalized. Using the matrix whose columns are the eigenvectors P = 
(ri, ..., rn), then A = PAP7! where 
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a10- 0 
0O àz- 0 

A=]. f, (5.6) 
0 0 A, 


where r; is the eigenvector associated with the eigenvalue A;. Defining the vector 
w :— P^ !u and multiplying (5.4) by P7! from the left, we obtain 


du du 
p — PA 
Ot Ox = 
po ap VL. us 
ot ox — 
ow Ow 
id GS esq 
ot Ox 


where we have used the fact that a;; are constant. The last equation indicates that 
the system decouples into n advection equations for the variables w; = (P-5j jj: 


Ow; OW; f 
A ÀjL— =0, i=1,...,n. (5.7) 


Notice the key result here; the eigenvalue A; of the matrix A is the velocity associated 
with the advection equation for the variable w;—that the eigenvalues are interpreted 
as velocities is key, as seen for the wave equation in Sects. 4.4 and 4.5, where (R, L) 
are the characteristic variables w,and w» for the wave equation. Its use will also be 
seen in flux balance laws below. 

The solution of these equations is exactly the same as for the advection equation 
constructed above, that is, for given initial conditions w; (x) of the variable w;, its 
solution in the whole domain is 


wi(x,t) = wi,o(x — Ait), 


and likewise for alli = 1,...,n. This result corresponds to the homogeneous 
system; however, the characteristic velocities are the same for nonhomogeneous 
cases where b Æ 0, because only the principal part of the equations is considered, 
although the exact solution is not the same due to the source. 


5.1.2 Variable Coefficient Case 


In general, the entries of the matrix A in (5.4)-(5.5) are not constant, because they 
depend either on the independent variables (x, f) or on the unknown functions u; 
themselves. 
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Let us consider the following IVP, a slight generalization of the advection 
equation problem: 


ðu ðu 

— 4 A(u)— = 0, u = u(x,t) 

ot Ox 

D = x € [Xmin: Xmax] x t € [0, tf] Domain (5.8) 
u(x, 0) = uo(x) Initial Conditions 

U(Xmin; t), U(Xmax, t) Boundary Conditions 


Following (5.2), the solution in this case would be u(x, t) = uo(x — A(u)t) for initial 
conditions uo(x) = u(x, 0). Notice however that à depends on the unknown itself. 
The paradigm of this problem is the Burgers equation. In this case, A(u) = u, and 
the corresponding IVP reads 


D) ð 
5 tus =0, u = u(x,t) 
D = x € [Xmin: Xmax] x t € [0, ty] Domain (5.9) 
u(x, 0) = uo(x) Initial Conditions 
U(Xmin, t), U(Xmax, t) Boundary Conditions 
whose solution is u(x,t) = uo(x — uo(xo)t) for all xo in the spatial domain. 


Notice the following: Assume there are two nearby space points xj < x2, where 
initial conditions are such that uo(x1) > uo(x2) > 0. The characteristic line 
passing through x; moves faster to the right than the one passing through x2. The 
crossing of characteristic lines produces the formation of a discontinuity. Then the 
finite differences method used in previous chapters fails due to the formation 
of a discontinuity on the unknown function, and consequently the formulas 
for the calculation of derivatives from Sect. 3.1 are not useful anymore, because 
discontinuous functions do not admit a Taylor series expansion. 

Let us see what happens when solving Burgers equation using the method of lines 
with a finite difference discretization. Consider the finite domain [Xmin, Xmax] = 
[—0.5, 0.5], with tf = 2, and the numerical domain Dg = {(x;, t”)}, with x; = 
Xmin +iAx,i = 0,..., Ny,, t" = nAt, using Ny = 1000 or equivalently Ax = 
0.001, and At = CAx with C = 0.1. Assume the initial condition is the Gaussian 
uo(x) = el 0.01 The semi-discrete version at the inner points of the numerical 
domain Dg will be 


Qu u Uj41 — Uj 
art‘ S 2Ax 


4 O(Ax?), (5.10) 
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Fig. 5.1 At the top left, we show the numerical solution of Burgers equation using the method 
of lines at various times, using the semi-discrete version (5.10). At the top right, the solution at 
t = 0.119, just after the discontinuity forms. In the bottom, we show the solution in the space-time 
domain and its isocontours, which are an approximation of characteristic lines and illustrate how 
these behave before the discontinuity forms 


with second-order accuracy in the right-hand side. The result using the RK2 time 
integrator is shown in Fig. 5.1. With these numerical parameters, by time t ~ 0.119, 
the solution becomes discontinuous and explodes later on. 

The lessons here are that when the equations are quasilinear, the solutions, even 
if initial data are smooth, can develop discontinuities and that the method of lines 
with a semi-discrete version that uses a finite difference approximation will not be 
able to solve the problem after a discontinuity forms. 

Now, let us return to the case of a system of various equations. In this case, the 
system of equations can be written as 


Pu + And = S(u). (5.11) 
ot Ox 


Likewise for Burgers equation, the characteristic velocities, namely, the eigenvalues 
of the matrix A, depend on (x, t) through u, that is, they are not constant like in the 
constant coefficient case and can develop discontinuities. This is the reason why we 


need to know how to handle discontinuities, for which the finite volume is a useful 
method that will help. 
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5.1.3 Finite Volume Method in 1+1 Dimensions 


We have seen that the nonlinearity of the equations of an IVP can lead to the 
formation of discontinuities. For this reason, numerical methods based on the 
continuity and smoothness of the involved functions, like the finite difference 
approximation of derivatives, are not suitable to solve this kind of equations because 
they are based on Taylor series expansions that need functions to be smooth. 

One of the most widely used approaches to handle discontinuous functions is 
the finite volume method, which considers a discrete domain with a cell-centered 
view in the space-time domain. Explicitly, the discrete domain D4 is similar to that 
we have defined so far. Consider the domain D = [Xmin, Xmax] x [0, tf], and then 
assume as we have done that the discrete domain is Dg = ((xi, t") | xi = Xmin + 
i Ax, t" =nAt}, where Ax = (Xmax — Xmin)/ Nx, At = CAx, with i —0,..., Nx 
and the integer label n, except that points of Dg are the corners of cells, the bricks 
of the finite volume discretization. 

In view of the formation of discontinuities, one cannot consider the state variables 
uj to be smooth. Therefore, the general scenario has to be that of discontinuous 
function that can be defined in general as a Riemann Problem, which is an IVP 
with evolution equations for a set of variables u, with initial conditions 


uz , for x < xo 


uo(x) = | (5.12) 


Ug , for x > xo 


where uz and ug are constant values, different in general, of the variables at the left 
and right from the point xo. In summary, initial conditions for u are discontinuous 
at xo. The evolution of uo will depend on the evolution equations of the IVP. 

One therefore has to assume that at each point of the numerical domain there 
may be a discontinuity of the variables that cannot be solved using finite differences, 
that is, a Riemann problem. The finite volume method is designed to approximately 
solve Riemann problems at each point of the domain, constructed using the integral 
version of the system of equations of the IVP. The integral version is assumed to 
hold at cells of the domain, unlike at points of D4. In Fig. 5.2, we show the relation 
between points of Dg and the cells of the domain. 

Let us illustrate the finite volume method considering the system of flux balance 
law equations: 


ðu — OF(u) 
prie = .1 
P + P S, (5.13) 


where u is the vector of conserved variables, F(u) is a vector of fluxes which 
depends on the variables u, and S is a vector of sources. First, the integral version 
of (5.13) considers the averaged integration of the equation over the volume of a 
cell pr as follows: 
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Fig. 5.2 In this figure, we present the discretization and cell structure of the space-time domain. 
White circles indicate the location of the elements of Dg. The cell Qu ? is centered at 
(x; , t 1/2), and its space-time volume is At Ax 


l ar al au dxdt + f” [ ii dxdt = 
At Ax Xi—1/2 n Ot At Ax Xi-1/2 n Ox 
1 Xi+1/2 poH 
= J f S dxdt, (5.14) 
At Ax Xi—1/2 t" 


where the volume of the cell is Ax At. Second, using Gauss theorem, this last 
equation can be integrated to obtain a discrete version of the integral form of the 
system of Eqs. (5.13): 


ant 1/2 gpn+1/2 
at! -u (E, E Fh) gn+1/2 
a t Ax u E PE 


where u; are the spatial averages of the conservative variables at time t": 


] fun 
= — u(x, t")dx, 
Ax Xi—1/2 


Sı 


and E are the temporal averages of the fluxes at space position x;+1/2: 


poH 


= 1 
BEE =a, [Fein pode 


1 
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Fig. 5.3 Illustration of the fluxes at the boundaries of the cell p 2 


gu 


Finally, S; is the space-time average of the sources 


poH 


- 1 Xi41/2 
Sue zx f S(t, x)dxdt. 
Ax At Xi-1/2 rn 


Equation (5.15) can be seen as an evolution equation for the state averaged 
vector of conservative variables u, whose a semi-discrete version developed around 
(xi, t”+1/2) is 


=n+1/2 gpn+1/2 
ou (E55 mi Pp) qn+1/2 
= +S; 


ot AX 


, (5.16) 


where the fluxes are evaluated at the boundaries between cells as illustrated in 
Fig. 5.3. In this view, Eq. (5.16) is a semi-discrete version of a system of equations 
that can be integrated, provided the fluxes at the intercell boundaries are known. 
The construction of these fluxes is essential to the method, and we exemplify its 
construction and implementation with the solution of Euler equations. 


5.2 1+1 Euler Equations 


Euler equations describe the evolution of a compressible, inviscid fluid, character- 
ized by its density, pressure, velocity field, and energy. Here, we focus on the one 
spatial dimension case, where all variables depend on a spatial coordinate x and time 
t. In these terms, the IVP involving Euler equations reads (see, for instance, [3]) 
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9p + 0, (pv) = 0 

à (pv) + à; (pv^ + p) —0 

9,E + 9,[v(E + p)] 2 0 p — p(x,t), p= px, t), v= v(x, t), 
E — E(x,t) 

D = x € [Xmin, Xmax] X t € [0, tf] Domain 

p(x, 0) = po(x), p(x, 0) = po(x) Initial Conditions 

v(x, 0) = vo(x), E(x, 0) = Eo(x) 

D mins t), P(Xmax, t) Boundary Conditions 

Din: t), Pmax: t) 

U(Xmins t), V(Xmax, t) 


E(Xmin,t), E(Xmax, t) 


(5.17) 


where each volume element of the fluid has density p, velocity v along x, total 
energy E — pv? + e), internal energy e, and pressure p. The system is 
underdetermined, with three equations and four unknowns (p, v, E, p), which 
is closed using an equation of state (EoS) relating three variables, for example, 
p = p(p. e). 

It is usual to consider the ideal gas EoS, which is given by p = pe(y — 1), where 
Y = cp/cy is the adiabatic index, the ratio between the specific heats of the fluid. 

Like Burgers equation in Sect.5.1, these equations are quasilinear, and the 
variables may develop discontinuities even if they are smooth. This makes the IVP 
illustrative of how the finite volume method captures the typical discontinuities 
developed in fluid dynamics. 

We write Euler equations as a system of flux balance laws: 


ðu F(u) 
ot Ox 


= S(u), (5.18) 


where u is the state vector, F a vector of fluxes, and S a vector with sources. It is 
important to name p, v, E, andp as primitive variables, which contain the physical 
information of the fluid. As a counterpart, one defines conservative variables u; = 
p, u2 = pv, u3 = E, which will be the entries of u. Euler equations in (5.17) can 
be written as a set of flux balance laws like (5.18) with 


p u1 pu u2 
u= j|pv|:=]|uļ|, F= pv? +pl= us/u| +p (5.19) 
E u3 v(E + p) u2(u3 + p)/ui 
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and S — 0. With the equations written in this fashion, one can use the MoL given 
an appropriate discretization of the divergence of the flux vector and the sources as 
suggested in (5.16). 

The finite volume discretization considers the points of the discrete domain 
Da = (Gi, t")), with x; = Xmin + iAx, t" = nAt, as the corners of space-time 
cells C}. The cell-centered domain is illustrated in Fig. 5.2, where two neighboring 
cells C a ? and C wu ? and some of the points of Dg are shown. 

The discretization of the divergence of fluxes requires the characteristic analysis 
that determines the characteristic variables of the system and their velocities of 
propagation, as seen in Sects. 5.1.1 and 5.1.2. An approximate version of (5.18) 
uses the chain rule to write down the system 


ðu dFou ag 

9t  duüx  -. 

du ou 

—+A— =S, 5.20 
ot d Ox ( ) 


where A is the Jacobian matrix 


OF /du, OF | /du2 OF) /du3 
A= | 0F)/du, 0Fo/du2 Ə F5/0us |. (5.21) 
OF3/du, 0F3/du2 0F3/du3 


At this point, it is useful to apply the characteristic analysis from the previous 
section. 

Let us construct the characteristic structure of A for the EoS p = pe(y — 1) 
used here. For this particular case in terms of the conservative variables, the vector 
of fluxes from (5.19) is 


u2 
2 


Fa) = | 38-2 0- Dus |, (5.22) 


à 
u 1 u) 
Va u3 — 5(Y Dia 


and the matrix A = gE in (5.21) reads 


0 1 0 
A=| -$v-9G» G-»0 prv-1|. (5.23) 
D FUD ae y 
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An important velocity scale is the speed of sound. For this EoS, the eigenvalues and 
eigenvectors of the Jacobian matrix (5.23) read (see, for example, [3]): 


Ay =v—-—a, àù =v, à; =v +a, (5.24) 
1 1 1 
rı = v—a , a= v , B= v+a 
ly +e+ — 192 1,2 
7 p/p — va jV 53V +e+ p/p + va 
(5.25) 


where a — Jy? is the speed of sound of the fluid. These elements are used to 


construct the solution to the IVP (5.17). 

Keep in mind that in order to implement the MoL for (5.16), one needs an 
appropriate discrete version of the second term in (5.18). 

In this book, we will use only the simplest of approximate flux formulas, the 
HLLE [3], which requires only the eigenvalues of the Jacobian matrix. Other 
formulas can be programmed on top of the codes provided later on. 

The essence of approximate formulas like HLLE (Harten, Lax, van Leer, 
Einfeldt, [4, 5]) is that they provide approximate values for the fluxes at intercell 
boundaries. In Fig. 5.4, we show a zoomed version of Fig. 5.2, illustrating the 
intercell boundary at x;+1/2. Variables to the left and to the right from this boundary 
will use L and R labels, specifically variables p}, p^, ve, vf, EL, EF, B p* and 
conservative variables ut, uł, u$, už, u$, už, to the left and to the right from the 
intercell boundary. 

Notice that in terms of L variables there will be a flux Fup, 1/2) entering the 
intercell boundary at x;+1/2 from the left and in terms of R variables there will be a 


flux Fuh , jo) entering from the right. 


(zi-1/2, 0") (i+1/2,t") (Ti+3/2,t") 


Fig. 5.4 Intercell boundary located between x; and xj+1. State variables, both primitive and 
conservative, at the left and at the right from this boundary are labeled with L and R, respectively. 
The arrows indicate the fluxes approaching from the left and from the right of the intercell boundary 
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Fig. 5.5 Illustration of the intercell boundary with fluxes at the left F(u“), fluxes at the right 
F(u^), and variables u* and fluxes F* at the star region, indicated with a very bold line. The 
distance travelled by the fastest mode to the left in the lapse At is A_ At, whereas the distance 
travelled by the fastest mode to the right in the lapse At is A, At. The shaded rectangle is auxiliary 
in the construction of the HLLE formula (5.31) 


The HLLE approximate formula assumes that the interesting dynamics happens 
between the fastest mode moving to the left with velocity A_ and the fastest 
mode moving to the right with velocity A, where the velocity of each mode is 
an eigenvalue of the Jacobian matrix A. Figure 5.5 illustrates the region of causal 
influence of the information at the point x;+1/2 that will help to construct the HLLE 
formula. 

The formula involves only the characteristic structure of the conservation 
law (5.18), related to the principal part of the equation, and the possible source 
vector is ignored: 


du 2 dF(u) _ 
ot ax 


0. (5.26) 


The integration of (5.26) in the volume [A_ At, , A At] x [0, At] gives 


A+At At au A. AL At aF 
—dtdx + —dtdx = 0 > 
a_ar Jo ôt aar Jo ôt 


At A4At At 
f u(x, At)dx — f u(x, O)dx +f Fà At, t)dt 
A-At A-At 0 


At 
-f FQ_ At, t)dt = Q. 
0 


The first integral is rewritten in terms of u*, the state vector in the star zone, whereas 
the second integral is split into two integration intervals [A_ At, 0] and [0, A+ Ar] as 
follows: 
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0 AL AL 
à+ Atu* — A Atu* — i u(x, 0)dx — f u(x, 0)dx + AtF(u*) 
At 0 

— AtF(u ) = 0, > (5.27) 

X. Atu* — A. Atu* + A Aru’ — X, Atu? + ArF(u^) — ArF(u.) = 0. 
(5.28) 

From this equation, one can solve for u* 

js àu? — X. u^ — F(u^) + Fou’) (5.29) 


dad 


In order to calculate the numerical flux, namely, F*, one has to add an extra equation, 
the integration of (5.26) either in the volume [A_ At, 0] x [0, Af] or in the volume 
[0, A. At] x [0, At] illustrated in Fig. 5.5. Here, we develop the integral using the 
second option: 


Ay At Ay At 
i u(x, At)dx — / u(x, O)dx + At (F(u?) — F*) =0 > 
0 0 


X, Atu* — A, Atu? + At (F(u?) — F*) =0> 
F* = àu" — A,u* — F(u’). (5.30) 


Substitution of u* from (5.29) into (5.30) gives 


— ALAy (u? — u^) FA F(u^) — à- F(u?) 
7 à+ — À ` 


F* (5.31) 


This is a formula for the fluxes at the intercell boundary x;+1/2 in terms of the 
fluxes at the left F(u^) and at the right F(u^) from Xi41/2. This flux is directly 
associated with the point x;+1/2 boundary and is finally written as [3, 6] 


L R R L 
pHLLE — al (utip) FORSE Cm T A+A- Q1 7 Wap) 
i+1/2 = Tes 


(5.32) 


where, as said before, A and A_ are defined as the fastest velocity to the right and 
to the left, respectively: 


Ay = max (0, A, 08, 08, af, a, AE), 


à- = min (0,08, a8, 08, af, 4, A), (5.33) 
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where the eigenvalues L and R of the Jacobian matrix are defined following (5.24) 
in terms of the primitive variables: 


Ar =vVL — 4L, 


L 
Ax = UL, 


i vL +aL, 


R 
"m UR — AR, 


ax = vm, 
AF = vg +ar, (5.34) 
where 


aL = y pry/p* 
ar = y pry/p® 


is the speed of sound for an ideal gas. 

Let us collect some results. Fluxes depend on conservative variables, and the 
eigenvalues depend on primitive variables, both L and R. This means that we still 
have to provide the values for all these variables at L and R cells from the intercell 
boundary x;+1/2. How these variables are constructed defines different flavors of 
the method. This step is called reconstruction of variables. 

A simple reconstruction of variables assumes these are constant at each cell. This 
is the Godunov reconstruction illustrated in Fig. 5.6. Formally, this reconstructor 
assigns values to either primitive or conservative variables w as follows: 
wp /2 = Wis 


R 

Wi41/2 = Wil (5.35) 
see Fig. 5.4. This method is first-order accurate. A second-order accurate method is 
the linear reconstruction and assumes the variables to be a line at each cell. One 
of the most popular linear reconstructor is the minmod, defined as follows: 


L 
Wi41/2 = Wi + Gi (%i41/2 — Xi), 


UP i2 = Wis + Oiti 41/2 — Xi (5.36) 


oi = minmod(m;—1/2, mi+1/2) 
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Fig. 5.6 Illustration along the spatial direction of the domain, of Godunov (top) and minmod 
(bottom) reconstruction of variables within cells. The curve represents a function, the dotted lines 
are the intercell boundaries, and the thick straight segments approximate the function assuming 
constant piecewise and linear piecewise approximations 


a if |a| < |b| and ab > 0 
minmod(a, b) = 4 b if |a| > |b| and ab > 0 
0 if ab <0. 


The arguments 7j.;/? and mj,;;? are the slopes of the variable w at intercell 
boundaries: 


Wi] — Wi 

Mj+1/2 = ur 
i+] ~ ^i 

Wi — Wi-1 

MT TAS 
l 1— 


Thus, reconstruction (5.36) assumes the variables are linear piecewise with slopes 
o; and o;+1. This is a better approximation than constant piecewise, and is second- 
order accurate. 

Let us wrap up everything together into a code that solves the IVP in (5.17). 


Workhorse Example: The Shock-Tube Problem 

This is literally the Riemann problem in Eq. (5.12) for two states of the same fluid, 
that is, density, velocity, and pressure are initially in two constant states, separated 
by a discontinuity at the center of the spatial domain. Euler equations drive the 
further evolution of the fluid variables. 
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We solve the IVP in the domain D = [Xmin, Xmax] X [0, tf] = [0, 1] x [0, 1] and 
define the discrete domain as Dg = ((xi, t”)}, Xi = Xmin +i Ax,i = 0,..., Nx, 
t” = nAt with Ax = (Xmax — Xmin)/Nx and At = 0.25Ax. The steps needed for a 
sufficiently ordered implementation are listed next: 


1. Initial Conditions. The initial conditions correspond to a fluid in two states 
separated by a wall at x = 1/2 and are 


_ jJonx<1/2 |. Jpoxz1/2 |Juvxz1/2 
P= a x > 1/2 p, x > 1/2 vw, x > 1/2’ 


where p1, 02. pi. p2, v1, andv» have constant values that define two different states. 

With these initial conditions on primitive state variables, it is possible to define 
the initial value of conservative variables for the ideal gas EoS p — pe(y — 1), 
according to definitions in (5.19) as follows: 


ui = p, 
u2 = pv, 
1 1 
un = B=0 (50? +e) = jp Ee (5.37) 


2. Calculation of HLLE Fluxes. From the first step on, we need to calculate the 
numerical fluxes in order to calculate the right-hand side in (5.16). These fluxes are 
given by formula (5.32) in terms of conservative variables, evaluated at the left and 
right from intercell boundaries, whereas eigenvalues of the Jacobian matrix (5.24) 
are in terms of the primitive variables evaluated also at left and right from intercell 
boundaries. 

An appropriate order of instructions is as follows: 


(a) Reconstruct L and R values of primitive and conservative variables using 
Godunov (5.35) or minmod (5.36) methods. 

(b) Calculate the eigenvalues of the Jacobian matrix (5.21) using (5.34). 

(c) Calculate A and A_ using (5.33). 

(d) Calculate the HLLE fluxes Fu} 2) and Ff , jo) needed in (5.32), using the 
results from (a) and expressions for F in formula (5.19). 

(e) Implement formula (5.32) for the fluxes FPLLE at Xi41/2- 

(f) Use the MoL with the expression (5.16) to integrate in time. 

(g) Implement boundary conditions on the conservative variables. 

(h) The evolution updates the conservative variables u1, u2, and u3, and primitive 
variables are needed for the calculation of the eigenvalues of A and for output. 
In the case of Euler equations, it is easy to recover the primitive variables by 
inversion of (5.37): 
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p =u], 
u2 
v=—, 
uy 
lus 
p=v-)|u3-z—}. (5.38) 
2 u1 


We call the attention to item (g) of boundary conditions we have to describe now. 


Outflow Boundary Conditions. This type of conditions are useful to study isolated 
systems that expel material, and the numerical boundaries are expected to be 
transparent. A basic construction of these conditions in a 1+1 problem copies the 
values of conservative variables at boundary points xo and xy, from the nearest 
inner neighbors: 


uo = uj 


UN, = UN,-I (5.39) 


for all entries of u. The effect is that the Riemann problems at intercell boundaries 
X1/2 and xyw,—1/2 are trivial, because the states at the left and right are the same. 
Therefore, there will be no dynamics produced at these intercell boundaries that 
could interfere with the dynamics at interior cells of the numerical domain. This 
explanation suffices for the reminder of the book, although we recommend the 
interested reader to follow higher-order and more elaborate approaches to these 
conditions in [3, 6]. 


3. Repeat All the Steps in 2. for the evolution of the system from t” to t”*! for all 
n in the numerical domain. 

All these steps are specified in the code MoLEuler.f90, that we use to solve 
the shock-tube problem, and are listed in Appendix B. 

There are four scenarios that result from the shock-tube problem that we illustrate 
using the parameters in Table 5.1. These four scenarios are characterized by the 
waves developed during the evolution, explained in a pedagogical fashion in the 
educative paper [7]. For illustration, we use Dg such that the spatial domain is 
[Xmin, Xmax] = [0, 1], discretized with N, = 1000 cells of resolution Ax = 0.001. 


Table 5.1 Initial conditions for the shock-tube problem in the four possible scenarios. In all cases, 
we use y — 1.4 


Case DL DR UL UR DL DR 
Rarefaction-shock 1.0 0.125 0.0 0.0 1.0 0.1 
Shock-rarefaction 0.125 1.0 0.0 0.0 0.1 1.0 
Rarefaction-rarefaction 1.0 1.0 —1.0 1.0 0.4 0.4 


Shock-shock 1.0 1.0 1.0 —1.0 0.4 0.4 
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; t=0.125 - - - 
Bs ` t-0.25 — 


Fig. 5.7 Two snapshots of the solution for the shock-tube problem in the rarefaction-shock case 


For the evolution, we set At = C Ax with C = 0.25 and use the RK2 integrator. We 
show snapshots corresponding to these four cases of density p, pressure p, velocity 
v, and internal energy e = 70 T of the fluid. The four cases are solved using 
the Godunov reconstruction, and later on, we compare the results with those using 
minmod. 

Rarefaction-shock case. The results obtained using the code above, at two values 
of time, are shown in Fig. 5.7. The density starts decreasing at the left which is 
a sign of rarefaction, whereas a shock wave is being propagated to the right. At 
time f = 0.25, in the plot of p, one observes the shock wave is located at around 
x ~ 0.94, whereas a contact discontinuity appears at around x ~ 0.72. Notice that 
the pressure is continuous at the contact discontinuity. The velocity, initially zero, 
becomes positive, which indicates that the fluid moves to the right. 

Shock-rarefaction case. This is the antisymmetric to the previous case whose 
solution is shown in Fig. 5.8. The higher density and pressure correspond to the state 
on the right and the fluid moves to the left. Even though the case is very similar to 
the previous one, it is important, because the fluxes have opposite direction and it 
serves to verify the methods and code work in the two directions. 

Rarefaction-rarefaction case. Density and pressure are the same in the two 
states at initial time; however, the initial velocities point outward. This produces a 
depletion of the central part of the domain, and two rarefaction waves are produced 
during the evolution, both moving outward. The results appear in Fig. 5.9. 
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Fig. 5.10 Two snapshots of the solution for the shock-tube problem in the shock-shock case 


Shock-shock scenario. In this case also, density and pressure are the same in the 
two states, and now the initial velocity of the fluid points toward the center of the 
domain. Two shock waves are formed in the process as shown in Fig. 5.10. 

Effects of using different reconstructors. For comparison, we use the rarefaction- 
shock case using the same numerical parameters and initial conditions. In one case, 
the variables are reconstructed using the Godunov method (5.35), and in a second 
case, we use the minmod reconstruction (5.36). The results at f = 0.25 appear 
in Fig. 5.11. Notice that the discontinuities are better captured with the minmod 
reconstructor. It would be ideal to compare with the exact solution; however, for 
this, we let the following exercise: 


Exercise. Using the recipe in [7], add the exact solution to the program 
MolEuler.f90, and calculate the error of the density using the two 
reconstructors. Also, attempt a convergence test and show that when using the 
minmod reconstructor the convergence is first order. What is the convergence 
order when using Godunov? 
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Fig. 5.11 Comparison of the solution using Godunov and minmod reconstructors for the 
rarefaction-shock case at time t — 0.25. The differences consist in that the contact discontinuity 
and the shock discontinuity are better captured by the minmod reconstructor 


Exercise. Program a code that solves Burgers equation (5.9) using the finite 
volume approach, and compare the results with those in Fig. 5.1. 


5.3 Application: Spherically Symmetric Hydrodynamical 
Solar Wind 


We will use a generalization of the previous code to simulate a spherically 
symmetric hydrodynamic solar wind. A hydrodynamic wind is a relatively basic 
model of wind that does not react to magnetic fields, in which case one would need 
to solve the equations of magnetohydrodynamics. 


Stationary Wind. The heliosphere is characterized by a nearly stationary wind that 
permeates the whole interplanetary space and is permanently being pumped from 
the solar surface. Here, we simulate the formation of such stationary solar wind. 
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Let us rewrite down Euler equations in general: 


9rp + V - (pv) = 0, 
9/(ov) + V-(V@ pv) + Vp = —pV6, 
8jE + V-[(E+ pv] = —pv- Vó, (5.40) 


where p, v, and p are the density, velocity field, and pressure of the gas volume 
elements; E — pv? + e) is its total energy, with e the internal energy related to 
p and p through the ideal gas equation of state p = pe(y — 1); and finally $ is 
the potential responsible for an external force acting on the fluid, which in our case 
will be the gravitational potential due to the Sun. Notice that in general, all variables 
involved depend on time and space. 

The system (5.40) is coordinate-independent and can be simplified under certain 
conditions. Assuming the wind is spherically symmetric means that the flux is radial, 
and the system simplifies when using spherical coordinates (r, 0, 9). In this case, 
v = (v^, 0, 0) and p, p, v', e, E are all functions of (r, t), whereas $, we suppose, 
depends only on r considering the Sun produces a stationary, spherically symmetric, 
gravitational field. 

Euler equations for a spherically symmetric flow reduce to three equations: 


a 1 0(r2 pu" 
P (rov) _ 
ot r2 or 
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2 r2 uc A TO; 
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to be solved in the domain (r,t) € [rmin; max] x [0, tf], which means that for 
spherically symmetric scenarios, described in spherical coordinates, the problem in 
three spatial dimensions can be reduced to a 1+1 problem in the (r, t) domain. 
There are various differences between this 1+1 problem and that in the previous 
section, where the spatial coordinate was Cartesian, not spherical. First is the factor 
1/r? in front of the divergence term, together with the factor r? within the flux 
components, which are consequence of the 3D spherical coordinates; second, the 
sources are nonzero. However, there is a very useful similarity, namely, the fluxes 
have the same expressions as for the one-dimensional Cartesian coordinate, and the 
system (5.41) can be written as the flux balance law: 
2 
ðu 9 (r^F) -s 


1 
9t r2 ðr (92) 


, 
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where 
p u1 1 "E " 0 " 
u= pu" — u2|, F= pecu rie Dus i S = roer 5 
E u3 Y us iQ D3 -—pW =F 
(5.43) 


and the flux entries as exactly like those in (5.22). Then the eigenvalues of the 
Jacobian matrix are (5.24) that we rewrite here: 


ài =v" —a, do=0', Aa =v +4, (5.44) 


where a = [y= is the speed of sound in the gas. 


The equations are to be solved in the spatial domain assuming the Sun is at the 
coordinate origin. The spatial domain will be the volume within the spheres of radius 
Tmin and Fmax. The inner radius fmin is chosen such that the characteristic velocities 
of the system (5.41) point all outward from the Sun, typically rnin ~ 20Ro, whereas 
the outer Fmax is chosen such that the domain contains at least Earth's position. 

The use of this domain has two important advantages: first is that at rmin the 
information enters the domain, and, second, maintaining the state variables constant 
at raj, guarantees that the flow will enter the domain and point outward from the 
Sun until the flow becomes stationary; another implication is that the domain does 
not contain the origin r = 0 and it is not necessary to deal with the regularization of 
the equations there. 


From Physical to Code Units. Solar wind parameters are usually the density, 
velocity, and temperature. Physical and code units are related through a scaling 
relation for each variable, Opnys = pop, pressure ppnys = pop, length lphys = lol, 
time fpnys = fot, velocity Upnys = vov, and temperature Tphys = ToT, where the 
naught index indicates the scale factors of each variable, the index phys indicates 
the quantity in physical units, and the quantities without index are in code units. 
We choose length units to be in solar radius and time in hours, that is, lọ = Ro 
and ty = 3600s, with which the scale of velocity is vy = /o/to. Temperature scale 
is given by Tp = m HY /kg where mg is the hydrogen molecular mass and kg 
Boltzmann's constant. Pressure and energy scale with constants given by po — ova 
and Ey = pov» respectively. 

When the equations of the system (5.41) are scaled according to these rules, the 


2 
second equation has an overall factor on the left x and on the gravitational source 


a factor 2: then for the equation to hold in code units, one has to multiply the source 
0 


1 


3 
Povo 
VE = 
lov 


Analogously, an overall factor in the left of the third equation is T 


term by 
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and on the right a factor £ ra o and then, in order for the third equation to hold, one 


0 
has to multiply the source term by the factor ug. 
ovo 


Physical and Numerical Domain. The mean Sun-Earth distance is ~ 214.83452 Ro; 
then we can set rmin = 20Ro and rmax = 220Rọ so that the domain contains the 
Earth. Since lọ = Ro, the domain in code units is simply rnin = 20 and Fmax = 220. 
Thus, we define the numerical domain Dg = {(r;, t”)} with ri = rmin + iAr, 
i —0,..., Ny, t" = nAt and resolutions Ar = (Fmax — Fmin)/Nr, At = C Ar. The 
base resolution uses N, = 1000 and C = 0.25. 


Initial Conditions. Traditionally, the properties of the solar wind are given for 
density Pwind, velocity Urin 4» and temperature Twina, and pressure has to be set in 
terms of density and temperature by p — oT. We define the initial conditions for a 
spherical Riemann problem, namely, a sphere of high density and pressure, whereas 
outside we assume an environment at rest with low density and pressure. We set the 
interface between the two states at the first intercell boundary of the domain D4 at 


rı = rmin + Ar as follows: 


Pwind> ifr <r, 
po(r) = 

0.1 Pwind, ifr > fi 

Vining ifr < ri 
vr) = 

0, ifr 


Dwind Twind ; ifr <r, 
po(r) — (5.45) 
O.lpwind Twina, ifr > ri 


where the factor 0.1 in the outside region is defined only to define a small density and 
pressure that will eventually be pushed away by the injected wind state variables. 
An important difference with the shock-tube tests showed earlier is that we do not 
simply release the fluid and let it evolve. In this case, we want to permanently 
inject the state variables of the wind through the inner boundary at fmin, in order to 
simulate the Sun permanently pumping plasma into the heliosphere. 


Evolution. We solve the evolution of state variables in (5.41) using a slightly 
modified version of the code used for the shock-tube problem from the previous 
section, with the RK2 Heun time integrator and the same HLLE flux formula. The 
two main tweaks are the addition of the sources in the equations and the permanent 
injection of the wind variables. This is done by resetting the variables with the values 
in (5.45) on the first cell of the domain at all times. 

Formation of the stationary wind. Following [8], as an example, we use the wind 
variables Pwind = 2100, v”; g = 2.5 x 109 m/s, and Tying = 5 x 10°K. In 


win 
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Fig. 5.12 Snapshots of density, velocity, and temperature every 50 time units, from initial time 
until the solar wind flow becomes stationary. The pulse of each variable propagates to the right and 
fills in the space with the solar wind fluid, between the spheres of radius r,,;;, and Fmax. The stars 
indicate the profile at initial time, and squares correspond to the final stationary profile 


Fig. 5.12, we show snapshots of the state variables that illustrate how the initial 
shock propagates along the radial coordinate, until the flow stabilizes and each 
variable becomes stationary by t ~ 775. 


Injection of a Coronal Mass Ejection. A coronal mass ejection (CME) is a burst 
of plasma ejected from the solar surface, due to the highly intense magnetic field 
activity and its topological changes that trigger the formation of small and major 
ejections of plasma. CMEs are the most important concept in space weather, because 
they transport plasma across the Solar System, with a certain front shock speed, 
and leave a trace of high temperature behind, and eventually interact with planetary 
atmospheres, producing magnetic storms. Prediction of the properties of the plasma 
carried by CMEs is of major importance, because it allows to predict effects on 
Earth and the satellite technology. 

Once we have a code that produces a stationary wind, we want to present an 
oversimplified version of a CME, yet illustrative of how it could be simulated in 
a more general scenario. It is simple, because again it does not carry a magnetic 
field and because in spherical symmetry it has to be a spherically symmetric blast, 
very different from CMEs, which are localized bursts, like those we show later in 
Fig. 6.18. 
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Fig. 5.13 Snapshots every 10 hours, starting from t = 800h, of density, velocity, and temperature 
during the propagation of the CME. The pulses of the three variables propagate to the right, and 
once the propagation has ceased, the stationary wind variables from Fig. 5.12 are recovered 


We inject this spherical CME as a denser, faster, and hotter pulse than the wind, 
with number density of 4200, twice the density of the stationary wind at rin, 
velocity vcmg = 6.5 x 10°m/s, and temperature Tc E = 10°K, that will propagate 
across the domain and leave through the boundary at rmax, until the stationary wind 
is recovered. The state variables of the CME are injected during 3 hours, at r,;;; in 
the same way as wind variables, during the time window t € (800, 803), which is a 
domain after the stationary wind has formed (Fig. 5.13). 


Diagnostics. Additional to the numerical solution of Euler equations, the useful 
information is the value of state variables at different space positions. For example, 
it is important to know the value of state variables at Earth, in terms of measurements 
made by probes flying around the Sun. In the spherically symmetric case, we cannot 
do much, but we can at least measure the state variables. Let us invent that the 
position of the Parker Solar Probe (PSP) is r = 0.532801 astronomical units and 
that Earth is at 0.985885AU from the Sun at the moment the CME above is ejected 
(keep in mind that this is actually a spherical blast wave). Then one can interpolate 
the value of state variables at detecting positions, say at positions of the PSP and 
Earth with the solution of state variables at the cells near detecting positions. We 
show the state variables at these two detection positions in Fig. 5.14. 
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Fig. 5.14 Density, velocity, and temperature at the invented position of the PSP and Earth. The 
CME is launched at ¢ = 800 and lasts 3 hours. It first reaches the position of the probe by t ~ 
830, and about 40 hours later, it reaches Earth. After that, the stationary wind variables are again 
measured by the detectors 


The Probe detects the high-density, high-velocity pulse, which leaves behind a 
hot region. About 40 hours later, the shock front is measured, with smaller density, 
velocity, and temperature at Earth. This simple exercise is an example of space 
weather; the properties of a CME are observed and measured near the Sun (with 
telescopes and probes); one should simulate a scenario, guess or find appropriate 
values of state variables oc wg, VCME, and Tcyg at rmin that reproduce those 
measurements (density, velocity, and temperature) and then solve Euler equations 
with such parameters in order to predict the state variables at Earth's position. 

The code SolarWind.f90 can be used to reproduce all the results in this 
section. It includes the conversion of units and the tweaks needed to convert the 
shock-tube solver into the solar wind simulation, as well as the implementation of 
detectors. The code can be found as Electronic Supplementary Material described 
in Appendix B. 


Exercise. (a) Using the code SolarWind. £90, extend the domain in such 
a way that it contains Pluto. (b) Find information of the solar wind density at 


(continued) 


5.4 Application: 1+1 Relativistic Euler Equations 233 


various distances from the Sun at a given date, because the solar wind profile is 
nearly stationary but changes slightly with time. (c) Run the code for a number 
of combinations of temperature, density, and velocity at the inner boundary, 
and construct a catalog of stationary winds. (d) Find the one consistent with 
observations at various radii found in (b). 


5.4 Application: 1+1 Relativistic Euler Equations 


Relativistic Euler equations describe the evolution of a perfect fluid defined by the 
stress-energy tensor 


TY’ = pghu"u" + py”, (5.46) 


where a volume element is characterized by the rest mass density po, specific 
enthalpy h = 1 + e + p/po, internal energy e, pressure p, and u^ its four velocity, 
whereas 7^" = ny = diag(—1, 1, 1, 1) is the Minkowski space-time metric. 

Euler equations consist of the conservation of mass and the divergence-free 
constraint of the stress-energy tensor that, using Einstein summation notation, are, 
respectively, 


9 
hs = 
sua (Pow ) = 0, (5.47) 
EA T"" 20 5.48 
3x” — , ( * ) 


where x^ = x9, xl, x2, x? or x^ = x9, x! are the coordinates of the space-time, 


where u = 0,1,2,3 label space-time coordinates and i = 1,2,3 label space 
coordinates only. Since x? is the coordinate time, we use indistinctly x? = ¢ in 
the calculations below. These equations can be cast in a flux balance set of laws 
that we construct based on the Valencia formulation [9, 10], for which we need to 
recall a few relations from special relativity. Considering the four-velocity of a fluid 
element has components u^ — (ul, ul ), the following relations hold: 


0 


o dt 1 i u dx ul 
= — = W = —— D — Å — eee 


dA f zem uU d W 


where ¢ is the coordinate time associated with a fluid element from a Eulerian 
reference frame, À the proper time measured at its location, and v' the components 
of its three-velocity and W its Lorentz factor. 
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Development of the conservation of mass (5.47) gives 


a 
oxi 


a a 0 : a a 
— (pou) = 3,0 (Pou )+ (pou') = 3,0 Pow) F 3: (0Wv) = 0, 


Ox" 


or equivalently 


dD a : 
de? nU eh 549 
Ot axi v3) ( ) 


where D = poW. Now, let us expand Eqs. (5.48), for which we need the components 
of the stress-energy tensor distinguished with time and spatial labels as follows: 
T'"" = pghu"u" + py" => 
T” = poh(u°)” + pi? = poh(u°)” — p = pohW? — p, 
TOi = T% = gohuPui + pn” = pghW? vi, 
T = pghu'u! + pi = pohvi vi W? + pd’. (5.50) 


With these expressions, we expand the summation in (5.48) for components of the 
stress-energy tensor with u = i, a spatial index: 


3 


Ox" 


puc Ti? — (eru 
(T) = (7) + (T) 


9 ; 9 ps ) 
3; (oh W*v) + gj Poh’ v! W? + pôi) = 0, 


or equivalently 


0S — 98 o, " 
a7 bau Siu! + pi) — 0, (5.51) 
where Sİ = pghW?v! is a new three-vector. For u = 0, the time coordinate, one 
has 
ð ð ð ; 
ca e gU Mg =e 


0 f ; 
3; (oh W* - p)+ ga CAW v’) =0, 


by adding (5.49) 
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a a , 
z-(ohW? — p — D) + — (pohW?v! — D) = 0, 
Ot Ox! 

reduces to 
à à. l 
T cS DSO. (5.52) 
ot ox! 


where t = poh w?- p — D is another new variable. The set of Eqs. (5.49), (5.51), 
and (5.52) constitutes the relativistic Euler equations in flux balance law form: 


En + : (Dv) 20 (5.53) 
Ot ax! iid ` 
as! Ü. ls 

o: + aum v! + pàij) = 0, (5.54) 
OT 0 ; : 

RET (S! — Dv) = 0, (5.55) 


where D, S', andt are the conservative variables. In these terms, an IVP for the 
1+1 relativistic Euler equations is formulated as follows: 


à, D + ði (Dv) 20 
9,5! + 9,; (S'v/ + pôi) 20 
8r + 8,i(S' — Dv) 20 D = D(t, xi), s = Sİ nx, 
T= t(t, x!) 
D, Si, t depend on po, vi, p, e, 
and x! =x,y,z,i=1,2,3 


D = [Xmin: Xmax] X [Ymin; Ymax] 


X [Zmin, Zmax] x [0, tr] Domain 
po(0, x'), vi (0, x!), pO, x'), e(0, x!) Initial Conditions 
D(t, dD) Boundary Conditions 
S'(t, AD) 
t(t, 0D) 
(5.56) 
The system of equations is a set of flux balance laws: 
ð oF’ 
E w o, (5.57) 


at j ax! 
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where u is the state vector of conservative variables and F the vector of fluxes 


D Dy 
S! Sy! + pô" 
u= | S|, F =| S% + ps |. (5.58) 
S3 S? y! + pd! 
T S'—Dy! 


Notice that in the limit v/ < 1, the enthalpy  — 1, and the conservative variables 
tend toward their nonrelativistic values: 


D — po, 
Sis pov! , 


t — poE = poe + pov? /2, (5.59) 


and Eqs. (5.55) reduce to the classical Euler equations (5.17). 

The solution of Eqs. (5.57) and (5.58) in three spatial dimensions is proposed as 
a project in Sect. 6.7.2. Meanwhile, in this chapter, we restrict to the 1+1 case. In 
the 1D case, the three-velocity has only one component that we choose to be v*, so 
that the sum v/v; = nij v! v/ = (v*)*. Consequently, there is only one component 
of S', specifically S*. Also, the domain reduces to a two-dimensional set D = 
[Xmin» Xmax] x [0, tr). 

Now, like in the Newtonian case, the system is underdetermined and is closed 
using a caloric EoS p = p(p,e), and like in the Newtonian case, one needs the 
dictionary between primitive and conservative variables that here we summarize. 
Conservative variables are defined by 


D = pW = 2 _, 
V/A - (y? 
S* = poh W?v* —  pohv* - 
1— (v? 


poh po 


1-0 Pa 


Now, the primitive variables in terms of the conservative variables read 


t = phW? — p — oW = (5.60) 


xL S* B S* 
pohW? t+pt+D’ 

ae 1 — (v*)? 
Ww $ 


p = p(po, e). (5.61) 
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We point out that pressure depends on density and internal energy. For the ideal gas 
EoS p = poe(y — 1), developing the third of Eqs. (5.61), we have 


P= poe(y — 1) 
—(y-D(ph-po—p) {h=1+e+p/po = poe = poh — po — p} 


D 
= » (ee jn p) 


w2 
ee, t+ D(1 — W) + p(1 — W°) 
= poly l DW | 
D(—W 1-w? 
- (y n aa (5.62) 


which means that pressure obeys a trascendental equation, unlike in the Newtonian 
case, where p could be written explicitly in terms of conservative variables. 

In order to solve this equation, we consider p to be the root of f(p) = p — 
poly — DeCD, v, W (v* (p))), that is, W is a function W(v*), which in turn is a 
function of v* (p). According to the last of Eqs. (5.62), 


1 tT+p+D 


1 
1 — (vx)? Se rd 4D)? — SF" 
-JaN Ep — ~ Jc pt D) 


(5.63) 


has to be substituted into (5.62) and then solve for p. The resulting transcendental 
equation f (p) = 0 is solved using the Newton-Raphson method, with f (p) and its 
derivative f'(p): 


DO- W 1 — W? 
fp-»-G D= AE 


w2 
s 
== + lc 1 
pt(y-Dr-(v ENTE 
Sx2 
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SUN (c+ p Dy 
fop)2-1-(y-D = (y — 1) 2 = 
= "'@+ptDy CU hh... («+ pt Dd)?’ 
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(5.64) 


where the value of pressure at iteration k is px = pr-1 — f (p)/f' (p), provided an 
initial guess for iteration zero, which can be the value of the pressure at previous 
time. 
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Like in the Newtonian case, one has to calculate the Jacobian matrix dF(u)/du 
of the system (5.57) and its eigenvalues. The eigenvalues of the Jacobian matrix are 
[10] 

vV + Cs V — Cs 


Àl = E Àn = ^ À3 = ; 5.65 
Wa 1+ vc; : ] — vc; ( ) 


where c; is the speed of sound defined by 


ð ð 
hd-x-(5]e xa, jrs, 
Po 


In our case p = poe(y — 1), thus 


0 
x2 eey-yn=H, 
9po po 
0 
= $ = poly - D. 
[2 


and then, using that h = 1 +e + p/po = 1 + 2 oy implies that the speed of sound 
is finally 


PA 
ELM: 


= py — Dr 
h poly — D + py 


c (5.66) 


Flux Formula. With all this information, it is possible to calculate the numerical 
fluxes at the intercell boundaries of the numerical domain, using like we did in the 
Newtonian case of Sect. 5.2, the HLLE flux formula (5.32): 


A4,F(u.) — 4 F(uF) + 4,4 (uA — u 
pHLLE _ M+ u“) (uw *) + ALA_( 1) (5.67) 
dc 
where A+ are defined by 
Ay = max (0, A, 08, 08, af, 4,4), 
à- = min (0, A, a8, a8, ab, af, AE). (5.68) 


and jr are the eigenvalues (5.65) evaluated at the left and right cells from intercell 
boundaries. With these fluxes, it is straightforward to use the MoL and solve the IVP 
associated with the relativistic hydrodynamics equations. 


Implementation. The implementation of the numerical solution is nearly the same 
as in the Newtonian case. Nevertheless, for the calculation of primitive variables in 
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Table 5.2 Initial conditions for two standard shock-tube test problems using y = 1.6 which is 
appropriate for a relativistic fluid 


Case PL PR vr UR PL PR 
Mild shock 10.0 1.0 0.0 0.0 13.33 0.0 
Strong shock 1.0 1.0 0.0 0.0 1000.0 0.01 


the Newtonian case, one uses relations (5.38), whereas in the relativistic case it is 
necessary to solve the transcendental equation (5.62) for p and then use equations 
of (5.61) to calculate v* and po and with these two the internal energy e from the 
EoS. 


Workhorse Case. Standard tests of relativistic hydrodynamics codes are again 
shock tubes, that is, the initial conditions define a Riemann problem. 


Initial data are defined for the primitive variables oo, p, v*. With these variables, 
one calculates the Lorentz factor, internal energy, and specific enthalpy: 


1 
W = —__., 
J/1- w)? 

p 
e = ——— —, 
poly — D 
jud doa 


PO 


and with these quantities, one constructs the conservative variables (D, S*, T) 
using (5.60). In Table 5.2, we indicate the initial conditions for two standard tests. 


Mild Shock. In Fig.5.15, we show a snapshot of the solution in the mild shock 
case using Godunov (5.35) and minmod (5.36) reconstructors. We also show the 
exact solution, constructed following the recipe in [7]. Notice that the exact solution 
captures exactly the discontinuities, whereas the numerical solutions introduce 
dissipation that smoothens out the discontinuities. It is also clear that using the 
minmod reconstructor, the solution is closer to the exact solution than using the 
Godunov reconstructor. 

These numerical solutions were calculated using N, = 1000 or equivalently 
Ax = 0.001, with At = 0.25Ax. 


Strong Shock. In this case, in order to approach the exact solution, one needs to use 
a higher resolution. For this, we set resolution label = 4, that is, Ny = 
1000 x 2? or equivalently Ax = 0.000125, with At = 0.25Ax. 

The results at  — 0.4 are shown in Fig. 5.16. A particular property of a strong 
shock is that a thin shell density forms while the fluid of the high-pressure region 
brooms the fluid of the low-pressure zone. The performance of minmod versus 
Godunov reconstructors can be noticed precisely at this shell. The density using 
Godunov fails to reach the value of the density by more than 20%. 
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Fig. 5.15 Mild shock test at f = 0.5 using Godunov and minmod reconstructors. The exact 


solution indicates the correct location of the discontinuities 


The implementation of this solution is written in the code Relativistic 
Euler. £90, which can be in the Electronic Supplementary Material. 


The transcendental equation for p is solved using the Newton-Raphson method 
at each cell of the numerical domain. For this, we use expressions (5.64) and iterate 
the pressure: 


a f (Pr-1) 
fi) 
for k = 1,2,..., with the initial guess pg=0 = pj, press guess. The process 


is iterated until the value of the root converges within a tolerance. In the code, 
we use pressK for pg, pressK p for pg-1, £un of p for f(pk-1), and 
funprime of p for f'(pi |). 


Exercise. Using the recipe in [7], construct the exact solution to the relativistic 
shock-tube problem. Incorporate it to the program and calculate the error of 
the density. 
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Fig. 5.16 Strong shock test at t = 0.4 using Godunov and minmod reconstructors. A property of 
a strong shock is that it forms a sharp thin shell of fluid 


5.5 Application: Spherical Accretion of a Fluid onto a 
Schwarzschild Black Hole 


Let us now bring relativistic hydrodynamics to the next level. The plan is to solve 
relativistic Euler equations on top of the background space-time of a Schwarzschild 
black hole for a radial flow. Like we did in Sect. 4.7, we use Eddington-Finkelstein 
coordinates to describe the Schwarzschild black hole. 

Consider the matter to be a perfect fluid, whose stress-energy tensor for a general 
space-time with metric gy is 


TY” = pohu"u" + pg", (5.69) 


where each volume element has rest mass density pọ, specific enthalpy h = 
1 + e+ p/po, internal energy e, pressure p, and four-velocity u^. Relativistic 
hydrodynamics equations consist of the conservation of mass and the divergence- 
free condition of the stress-energy tensor. For a general space-time, these laws read 


V (pou^) = 0, (5.70) 
Vie = 0, (5.71) 
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where V, is the covariant derivative consistent with the metric guv, where x^ = 
x9, x}, x?, x? or x” = x, x! are the coordinates of the space-time, u = 0, 1,2,3 
labels space-time coordinates, and ; = 1, 2, 3 labels space coordinates only. Since 
x? is the coordinate time, we use indistinctly x? = t in the developments below. 

These equations can be cast in a flux balance set of laws that we construct based 
on the Valencia formulation [10, 11] and the 3+ 1 decomposition of space-time (see, 
for example, [12, 13]). First we write the line element of the space-time metric in 
the 3 + 1 decomposition notation: 


ds? = (-a? + B' Bi)dt? + 2B;dtdx'! + yijdx' dx, (5.72) 


where a is the lapse function, f! is the shift vector, and y; j is the three-metric of 
the spatial hypersurfaces of the space-time with i, j labeling spatial coordinates and 
Bi — yij B/. With this metric, one can construct expressions for the four-velocity of 
a fluid element u^ = (u?, u!), in terms of the three-velocity 


dt W 1 s.c ui — p 
u? = — = A U——-——- Em 
dA [94 a a v! vj uo W a 


where ¢ is the coordinate time associated with a fluid element from a Eulerian 
reference frame, A is the proper time measured at its location, W its Lorentz factor, 
and v! are the components of its three-velocity according to the Eulerian observer 
itself. In the expressions above, vy = yij v! vl . 

With all these definitions and following [10, 11], one can write Eqs. (5.70)-(5.71) 
as a flux balance set of equations 


du OF’) 
Ot ax! 


= S(u), (5.73) 


with the following state vector u, vector of fluxes F, and vector of sources S: 


D a(vi-f)D 
u=(s,], Fw=]a (v - £) Sj +a /y pb |. 
P o (v! - £) c nu pv' 
0 
S(u) — o SYT” gus I? yj ; (5.74) 
a Y(T 3 æ — aT” T’ wv) 
for i, j = 1,2,3. Conservative variables are defined in terms of the primitive 


variables and geometric quantities by 
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D = y pow, 
S; = JV pohW?vi, 
t = Jy (pghW? — p — poW). (5.75) 


This is an underdetermined system of five equations for six primitive variables 
p, V', e, and p. In order to close it, we assume the fluid obeys an ideal gas equation 
of state 


p = poell — 1), (5.76) 


with I” = cp/cy the adiabatic index. 

We now restrict to the case of a spherically symmetric space-time written in 
spherical coordinates (r, 0, $, t). The most general 3+1 line element under these 
conditions is 


ds? = (—o? + BB” )dt” + 26,dtdr + y,,dr? + yoo (d0? + sin? 6d”), — (5.77) 


where all the functions depend on (r, t). 

From this metric, one has that if y = = Hel j), then YY = /VrrYoo sin. 
Penang there is only radial motion, then v' = (v”, 0, 0), which a ae viv! = 
yr, v' v”. Consequently, the components of S; are 5, = „y poh W? Yrru”, So = 
JY poh W?yggv? = 0, and Sg = Jy poh W? Ypo v? = 0, the two later are zero due 
to the condition that v? = v? = 0. 

Therefore, the system of Eqs. (5.73)-(5.74) becomes 


du  8F'(u) " dF? (u) " 8 F?(u) 


at dr 30 p c9 oe) 


with the following state vector, flux vectors, and sources: 


D D JV POW 

S, S, Y ooh W? v, 
u=]S |=] 0 /= 0 ; 

Sp 0 0 

T T VY (ooh W? — p — po W) 

Br : 
«(v - £)p e(v - £n 
Br r r 
a (v — a + o y ps" a (v -= £) s ca yp 
F'(u-l[ao (v - E) Sota /ypó) | = 0 ; 
a (v - E) So +a /yp3 s 


o (v' -E)rreyypy a(v - E )v rayo 
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6 0 
v? "s S, Ta 0 
O(n) — "Eu el- 
F” (u) = woo ta/y ps, | = | a/yp |. 
NEN + 58 K 
a ) So + 0 / Y P9 d 
6 
RON in 
«(vt - £)p 
0 
a (vt - £)s. +a /y poe 0 
F?(u) = a (vt — E) So +a /y poe = 0 ; 
a (v? — E) Sp oy pis Ea 
a (v - Pray pet 
0 
a SVT gus I? ur 
S(u) = o SYT” gus P? po ; (5.79) 
a / Y T" 8vo D ud 


a /y (Td, — o T"" T? wv) 


Since F^ and F? have a nonzero component each, it is worth discussing 
the implication in Eq.(5.78). Let us first see Fº, notice that a/yp = 
a(t, r)J/yrr(t, r)yee(t,r) sind p(t,r), therefore ue = 0, and thus the fourth 
term in (5.78) vanishes. 


The third term im in Eq. (5.78) is not as simple, and for its discussion, we have 
to first explicitly calculate the sources S. Let us then calculate the nonzero stress- 
energy tensor components that will contribute to sources: 


700 


1 2 
za (oh W — p). 


hW? r r 
T"? - PO (v B )+ m 
a 


a a 
r rear 
T = pohW? (r — "y + (v — 2s )r 
T?? — Eus 
Yoo 
Té? — P 


(5.80) 
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The other components are zero because u? = u? = O or g? = g? = g"? = g"? = 
g°? = 0. Also in the sources, there are the Christoffel symbols of the space-time 
metric. The nonzero ones for the metric (5.77) are the following: 


(rr — 2 B" — B' yl.) B + 2o (à + o B") 


Poo = 
ii 2a? 
2 / r ( VOS) T! _ pr,,! 
re | AA + BY (Yr yrr B B Ver) 
Or 2a? , 
Yr — 2ys B" — By; Yoo — B' y; 
r5, _ Yer m iA pa ny to 3 pg E sin? 0 255, 
Iw = 1| 8 (8" (yos b” T 2yr” + 295. B") = 2ad) 
00 = 2 n2 


1 r2 ] : : 
bs (= == TA PY +2 (Yer — Ye B") B' + 2ao + 222] , 


Qo 1 (Hier + Yr B+ Bi) Y 2E y 
or = 2 F E 
2 a a Yrr 


a 
IF r= 


1 (yy, ra p" (—Yrr + 2Yrr B" + B” yir) 
2 Yr a i 


Pc 1 (£ (8" Yio — Yoo) i) 


2 a? Yrr 
f Yoo 6 Yoo 
I" = sin? 01" go, Pea, I 9 = ——, 
m 2'yeo U^ 2yeo 
Yoo % 
Pog =—cosdsind, To= 2, T’, =, p6,,-— cot, (5.81) 
2V99 2ygo 


where, for the sake of compactness, we used prime and dot to indicate derivative 
with respect to r and t. 
With the nonzero stress-energy tensor components (5.80) and the nonzero 
Christoffel symbols (5.81), the five entries of the source vector in (5.79) are 
020 
o / y T gus I? ur = o y CT Co? + yer (BT or + Yer BYE" or 
+T” (ae F ee Le + yrr T" or 
yr B' (7 rr + Por) 
+T Yer LD rr + Vee T? r] 
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+T yog 9 o, + T99 yao To; J; 
a SYT” gol? po = yY pcot6, 
a SYT” TV = 0, 
a /y (TH ð a — aT’ Puy) = a /y( Taga — a9) + T' (8-4 — 2a 9,0) 
—a(T r9,, + TP gg + T99 9,5) ). (5.82) 


Now, we note the importance of F 8 which accounts to the third term of the third 
equation in (5.78), because 


8F? 
ug 7 8e[a (t, WV Yrr(t, r) yoo t, r) sin8. p. r)] 
= a(t, r)V/ Yrr (t, r)yoo(t, r) cos0 p(t,r). 


On the other hand, the third entry of the sources (5.79), namely, the third of 
Eqs. (5.82), is precisely œ | /y;. Yoo sin @ cot @, and therefore, these terms in the third 
of Eqs. (5.78) cancel out. Then only three out of the five Eqs. (5.78)-(5.79), first, 
second, and fifth, are nontrivial. 

Therefore, one can define the following initial value problem for the evolution of 
the spherically symmetric flow of a perfect fluid on top of a spherically symmetric 
space-time written in the form of (5.78), which reduces to three evolution equations 
only: 


aD +a, (« (v » Z) D) =" 
a 


z 
dS, + or (« ü = Z) S, +ay7p) = a SYT” gel? pr 


: 
dt + 9, (« (v - Z) S, + ey7p) = a /y(T"93,o — oT" T’ wv) 


D=D(r,r), S =S,(r,t), T= T(r, t) 


where the variables D, S,, t depend on po, v”, p, e, through Eqs. (5.75) 


D = [Fmin, fmax] X [0, tf] Domain 
po(0, r), v (0, r), p(0,r), e(0,r) Initial Conditions 
D(t, 9D), J, (t, dD), t(t, OD) Boundary Conditions 


(5.83) 
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Characteristic Structure of Equations (5.53.) In order to use the finite volume 
approach with the HLLE flux formula as in previous sections, one needs the 
characteristic structure of the system of equations, at least the eigenvalues of the 
Jacobian matrix S in Eqs. (5.78)-(5.79). We do not calculate them here; instead, 
we take the eigenvalues from equations (21) and (22) in [11], which are 


Ay — av' — p”, 


"n a 
2= ————— 
1 — vv'c? 


x [va - 2) + esy = veni — vere) - vv — &| =p", 


Q 


1 — vv'c? 


x [va — c2) — NA. — vv) [y (1 — vru" c?) — v'v'(1 — &| — fl, 


(5.84) 
with c, the speed of sound as in (5.66): 
X km Pair 
d- NE] Mc. E (5.85) 
h pod’ — D) + pr 


The dictionary between primitive and conservative variables is in turn as follows: 
Conservative variables are defined by 


po 
poyo 
v 1— yrr (v")? 
Y poh yy, v" 
Seppe 
PS eA 


A/Y poh po 


I-y»,Qy P!" Flay ere 


The primitive variables in terms of the conservative variables read 


t = Jy (oohW? — p — poW) = 


(5.86) 


T S, u S, 
JY pohW? yr (c+ vp + Dye 


D D 1 (ry 
po = = yl yrr 0}, 
W/V JY Tr 


p = P(p0, e), (5.87) 
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where the latter is a caloric EoS, in which the pressure depends on density and 
internal energy. Developing the third of Eqs. (5.87), we have 


p = poell — 1) 
= (I — 1)(poh — po — p) {since h = 1 +e + p/po = poe = poh — po — p} 


1 T D 
=(r-1) e (5 +pt+ z) po p) {from (5.86)} 


= t+ p/Y t D — po /YW? — p/yW? 
= ør- 1) z 
poy Y W 
7 tT+D(1— W)+ p/y(l — W?) 
= po — 1) l DW | : 
- _ 2 
pes E ai NTC H | l (5.88) 


which is a trascendental equation for p and slightly more general than (5.62) due to 
geometric factors. 

In order to make this equation more explicit, we consider p to be the root of the 
function f (p) = p — po(1^ — 1)e. According to the first of Eqs. (5.87), 


m l l 00 AG yp D) 
y1 - Ver (UT)? S2 t+ +D} — S2 
1— yeh yee Jv J/YP ) r 
(5.89) 


which substituted into (5.88) defines a transcendental equation for p that we solve 
using the Newton-Raphson method, which locates the zeroes of the function f (p): 


D1—-W 1- w? 
f(p) = p- |= UNT e], 


(r=) ( y" s; ) 
CET UE (D+ pJy +t)? 


1 1 
t+D 1 + pJ/y 1+ rr §2 
y"s C1 m) 
! Orage (D+pJ/y¥+t) 


(5.90) 
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(P= Dy" S2(" S + (D+ py +T) 

y"s 
(-vre-+0(-14 i S) 
(D+ pJ¥ t x (-y'* S2 + (D+ py - 1))) 


f'(py=1+ (5.91) 


The values of p are iterated with the relation py = pk-1 — A ) , until a tolerance 
is achieved, for each cell in the domain. The initial guess we use to start the loop is 
Pk=0 = (Pi + Pi+1)/2, which is an average of the pressure at two neighboring cells 


at the previous time step. 


Now, these results are valid for an arbitrary spherically symmetric space-time. 
We restrict now to the case of a Schwarzschild black hole described with Eddington- 
Finkelstein coordinates, whose line element is 


2M 4M 2M 
ds? = — ( — t) dt? + —dtdr + (1 + =) dr? + r?(d0? + sin? 049), 
r r r 
(5.92) 


where M is the mass of the black hole and (r, 0, $,1) the coordinates used to 
describe the points of space-time, like we did for the wave equation in Sect. 4.7. 
Identification of (5.77) and (5.92) leads to the 3+1 gauge and metric functions: 


1 
a= ; 
14+ 
f=¢00=(—— 10.0 
mE $ s = r 1+ 24°" , 


: a. : 2M 5 2.2 
Vij = diag(yrr, Yoo, Sin” 0ygg) = diag | 1 + srr sin 6), 
. 2M 
Br = yup = PX 


. | 2M 
JY = J¥rrVooVeo — r^ sinb, 1+ ae (5.93) 


The nonzero Christoffel symbols for the EF space-time metric (5.92), needed to 
calculate the sources in (5.79), are the following: 
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Doy = ZE, Tv = 4 (14), ry =F, re, 2E 4), 
r2 -M(re34), r=, reg =, T5, = —2M, 
D), =—2Msin?@, P= M (1- 2M), rra, 2M - 5 Pog = QM - r)sin'6, 


I? gy = — sin cos, I? og =cotd. 


This completes the information needed to simulate the dynamics of a perfect fluid 
being accreted spherically by a black hole. 


Domain. We set the inner boundary at rmin = M in order to allow the matter 
to enter the horizon, and the external boundary at Fmax = 51M, sufficiently far 
from the horizon. We define the numerical domain Dg = ((ri, 1")), where r; = 
Tmin tiAr,i —0,1,2,..., Np, Ar = (Tmax — Fmin)/ N; and t” = n At; we choose 
as base resolution N, = 1000 or equivalently Ar = 0.05. Time is discretized with 
resolution At = 0.25 Ar. Moreover, in all the examples, we set the black hole mass 
to M — 1. 


Initial Conditions. We consider the fluid to have initially a constant density 
p (r, 0) = pc and constant inward velocity v” (r, 0) = v} < 0. 


Evolution. For the evolution, we use the RK3 integrator. 


Boundary Conditions. Since we want to simulate a process of accretion, at the 
outer boundary (Fmax, t), we maintain the inward flux at all times and impose time- 
independent Dirichlet conditions. Then we set the right-hand sides of D, S,, andt 
to zero at this boundary. 

At the inner boundary, the excision boundary (fmin, t), due to the light cone 
structure in Fig. 4.16, we extrapolate the values of the conservative variables as 
follows: 


Do = 3D, — 3D» + Ds, 
So = 3S; — 3S2 + 83, 


TQ = 3r = 3v; + T3, 


after each intermediate step of the evolution integration within the steps of the RK3 
method (4.5). These formulas are obtained from the Lagrange interpolation formula 
with three points (see, for example, [14]). 

With these initial and boundary conditions, the fluid dynamics will lead the fluid 
to a stationary inward flow. We illustrate this evolution process for two emblematic 
exact solutions, the stationary accretion of a pressureless fluid known as the Bondi 
solution [15] and the Michel stationary solution for the accretion of a perfect fluid 
with pressure [16]. 
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Accretion of a pressureless fluid assumes that the fluid accreted onto a black hole 
is dust, p = 0. There is an exact solution to this problem. In [17], the solution 
is developed for the Eddington-Finkelstein metric, and the density and velocity 
profiles are 


0,dust(r) = p 


, (5.94) 


Mauss) = 2M , 2M 
: 
[1+ 3 ( HJ + d 


where C is a constant of integration. Since we set the initial density and velocity 


profiles to constant, we will set their values to pọ = dust(Tmax) and v'(r) = 
VU Lust Tmax)» respectively. Following the example in [17], where the authors use 
C = —0.195, here, we show the results for C = —0.5, just to have a different 
case. 


With all this information, instructions to initialize the variables are as follows: 


— Set po(r, 0) = paust (Fmax). 

— Set v” (r, 0) = v5, max). 

— Setp=0. 

— Sete = ZET =0, 

— Calculate h = 1 + e + p/p. = 1. 

— Calculate W and then D, S,, and x using (5.75) and (5.93). 


— Then start evolution. 


For these initial conditions, the results of the evolution are in Fig. 5.17, where it is 
shown that at t = 0 the profiles of density and velocity are constant, and with time, 
the flow becomes consistent with the exact solution (5.94). This numerical solution 
shows that the exact solution behaves as an attractor in time provided some fixed 


, -0.14 
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Fig. 5.17 Numerical solution at £ = 0 and t = 200M for po and v”, together with the exact 
pressureless solution for C = —0.5. The coordinate r is in units of M 
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values of density and velocity feed the inward flux from the external boundary at 


r = Fmax. 


Michel Accretion. This is the spherically symmetric stationary inflow of a perfect 
fluid with p Z O onto a black hole [16]. Didactical descriptions of this solution 
can be found in references [17] and [18]. Michel solution is parametrized by two 
constants o. and r¢, and unlike dust solution, Michel solution does not have a closed 
formula for the hydrodynamical variables. 

Similar to what we did for the pressureless case, here, we set initially constant 
values for density, velocity, and pressure, which are those of the exact solution with 
I = 4/3, p, = 0.1, and re = 100 evaluated at Fmax. The system is initialized as 
follows: 


— Set Ir = 4/3. 

— Set po(r, 0) = pmichet (Fmax). 

— Set p(r, 0) = puichel (max). 

— Setv'(r, 0) = VMichel (max). 

— Calculate e — zd 

- Calculate h = 1 + e + p/pe. 

— Calculate W and then D, S,, and t using (5.75) and (5.93). 
— Then start evolution. 


The results are shown in Fig. 5.18. We show the initial conditions for pọ and v" 
and their values at t = 500M. With evolution, the numerical solution resembles the 
exact Michel solution represented with points. 

Another common setting can be written in terms of the asymptotic values of the 
speed of sound and velocity of the fluid. Assume that at Fmax, we impose the density 
to oo(*max) = po and the velocity magnitude to |v.|. In order to properly define the 
velocity field v', we notice that 
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Fig. 5.18 Exact Michel solution and the numerical solution of p and v" at initial time t = 0 and 
at t = 500M when the flow has become stationary 
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i [uc] i [ve] 
lve? = veii = yr 2 w= 2 vi =(-—£,0,0), 
Yrr Yrr 
(5.95) 
where we use the negative sign due to inward motion. 


Now the pressure. For this, we use the speed of sound expression (5.85), from 
which pressure can be expressed in terms of a given value of the speed of sound c;: 


2_ pq-Dr poc? 
ux Ber. MV EE. EN (5.96) 
s= pP -D-4 pr PUT-ddq 


in fact one can choose to set either p or c, for a given adiabatic index I”. We choose 
Cs because one can estimate the Mach number of the fluid at Fmax easily. Setting 
initial data is as follows: 


—- Set I. 

— Set po(r, 0) to a constant value. 

— Setcs « /I — 1 for it to be real. 

— Use (5.96) to calculate p. 

— Calculate e — zd 

— Calculate h = 1 + e + p/pe. 

— Set |v.| and calculate v/ using (5.95) 

— Calculate W and then D, S, and r, using (5.75) and (5.93) 
— 'Then start evolution. 


We illustrate the solution using the values 


f 4f. 
po(r, 0) = 1077, 
c; 20. « JT — 1, 
|u.| = 0.5. (5.97) 


Notice that velocities are in units of c = 1, which means that this case uses very 
high speeds. 

We know the variables start being constant and evolve toward a stationary state. 
What remains time-independent is the value of the variables at Fmax. We can 
formally estimate the Mach number of the flow at the outer boundary as follows: 


ME. 2 W |velfmax)| = W ML, = VI = lesCna dl” yy 
Ws Cs (Tmax) Ws v 1— [ve re le 
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Fig. 5.19 Snapshots of p and v”, showing the evolution toward a stationary flow. The dashed line 
indicates the values of p and v" at initial time. The top plots correspond to |ve| = 0.5, and the 
bottom ones correspond to |ve| = 0.2 


with MÈ, and Mœ the relativistic and Newtonian Mach numbers, whereas W, is 
the Lorentz factor for the speed of sound and W the Lorentz factor of the fluid 
velocity. Then for initial conditions (5.97), Mach numbers at Fmax are 


MR 


Tmax 


= 5.038, M =. 


Tmax 
In Fig. 5.19, we show the evolution of these initial conditions. The velocity profile is 
considerably different from that in the dust case and the Michel case in Fig. 5.18. For 
this reason we also show the results for |v.| = 0.2 corresponding to M m. — 2.061 
and M,a = 2, whose results are more similar to the Michel case in Fig. 5.18. 

The code BlackHoleAccretion.f90 is structured in the same order as 
that of relativistic Euler equations, uses the variables and shorthands described 
in this section, and is part of the Electronic Supplementary Material described in 
Appendix B. 


A final comment is in turn as follows: All physical quantities can be translated 
from geometric to physical units. The mass of the black hole is an important quantity 
of space-time that scales all the fluid state variables. For translation of units, we 
recommend Appendix A of [19]. 
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Exercise. The snapshots in Fig.5.19 suggest that Michel solutions are 
attractors. Define the initial conditions as in the text, except that density can 
be po(r.O) = pmichel (Tmax) + Ae“ -20y Run simulations for different 
values of A, and show that in the end, the flow becomes again the same 
Michel solutions of Fig. 5.19. This would indicate that Michel solution, given 
consistent density and velocity values at the outer boundary, is an attractor. 
For this exercise, it may help revising Sect. 2.11.5. 


5.6 How to Improve the Methods in This Chapter 


It is an advantage to account with knowledge to implement the simple methods 
described in this chapter. On top of these various elements can improve. 

One part is the reconstruction of variables at each cell. Here, we described 
and used Godunov and minmod reconstructors. Other options are the maxmode 
or superbee limiter, the monotonized-centered (MC) limiter, and the piecewise 
parabolic method (PPM) reconstructors. Higher-order reconstructors include the 
class of essentially non-oscillatory (ENO) method and its weighted version WENO 
reconstructors. These methods are well described in [19]. 

Another essential part is the calculation of numerical fluxes. In this chapter, we 
described the approximate Riemann solver HLLE which has been good enough 
for the examples developed here but constructed based on the propagation of only 
the two fastest modes, leaving all the information in between incomplete. More 
complete Riemann solvers can be programed with small adjustments to the codes we 
have constructed. For example, the HLLC can handle the contact discontinuities that 
may develop within the two fastest modes; Roe and Marquina solvers also prevent 
the violation of entropy conditions among others. These methods are described in 
[3, 6, 19]. 


5.7 Projects 


With the methods described in this chapter, it is possible to carry out the following 
projects: 
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Fig. 5.20 On the left, we show the maximum of ,/7,; as function of time (continuous line) and the 
value it should have in the continuum (dotted line), for a stable TOV configuration with K — 10, 
adiabatic index l” = 5/3, and central density po. = 0.0006. On the right, we show snapshots of the 
lapse function o during the evolution of an unstable TOV star with polytropic constant K — 10, 
adiabatic index 7" = 5/3, and central density po; = 0.0025. The collapse of o illustrates the 
formation of a black hole 


5.7.1 Evolution of a Relativistic TOV Star 


In Sect. 2.11.7 from Chap. 2, we constructed stationary solutions of relativistic TOV 
stars. In Sect. 5.5, we described the methods needed to study the spherical accretion 
of a perfect fluid onto a Schwarzschild black hole. 

A project consists in combining the two elements and evolve the equilibrium 
TOV stars within general relativistic hydrodynamics. In reference [20], the methods 
described here were used to evolve these configurations. 

Relativistic Euler equations use exactly the same methods described in Sect. 5.5, 
but this time, Einstein equations are solved simultaneously, and thus geometry 
evolves in time. The paper uses a constrained evolution with an appropriate gauge, 
such that Einstein equations, for a spherically symmetric space-time described with 
spherical coordinates, reduce to ordinary differential equations that can be solved 
using the RK4 method for metric functions, at every time slice. 

Two important results: One is that stable TOV stars oscillate and remain long- 
living, whereas a configuration of an unstable TOV star collapses and forms a black 
hole. These two results are at hand using the methods implemented so far in this 
book. 

In Fig. 5.20, we reproduce some interesting results found in [20]. In the first plot, 
we show the maximum of the metric function ,/7;, for a stable TOV star from 
Fig.2.31 with K = 10, P = 5/3 and central density poc. = 0.0006. In theory, these 
equilibrium configurations are stationary, and consequently, metric functions should 
remain time-independent, but in practice, there are numerical errors introduced in 
the construction of the configurations of Fig. 2.31 and also numerical errors during 
the evolution that add a permanent perturbation to the configuration. This type of 
perturbations serves to study the oscillation modes characterized by density and 
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compactness of configurations. Then a first project would be to reproduce this result 
for various values of the central density poc in the stable branch of Fig. 2.31 and 
construct a diagram of M vs frequency of oscillation. 

In the second plot of Fig. 5.20, we show the evolution of the lapse function o 
of an unstable TOV star in Fig. 2.31, with K = 10, I" = 5/3, and central density 
poc = 0.0025. The black hole horizon is formed when this function collapses to zero 
and then an apparent horizon is formed as well as an event horizon as illustrated 
in [20]. A second project can be the reproduction of these results, along with the 
construction of a routine that calculates the growth of the black hole event horizon. 


5.7.2 Nonlinear Michel Accretion 


The Michel accretion problem from Sect. 5.5 can be generalized to the nonlinear 
case, where the space-time evolves in time. In this way, the flow does not only enter 
the black hole, but the black hole horizon grows. 

The additional work consists in the implementation of the solution of Einstein 
equations for which a recipe can be found in [21]. In this reference, Einstein 
equations are written in the 3 + 1 decomposition of space-time using the ADM 
formulation. Then evolution equations for the components of the three-metric of 
space-like hypersurfaces used to foliate the space-time and the components of their 
extrinsic curvature are coupled to the evolution of the perfect fluid from Sect. 5.5. 

In [21], diagnostics tools can be found and can be easily programmed, including 
the location of the apparent horizon in time, its area and mass, and the accreted flow, 
not only through the integration of matter but also through the mass growth of the 
black hole itself. Methods are described also to construct the event horizon growth 
tracker. 
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Chapter 6 
Initial Value Problems in 3+1 and 2+1 SUN 
Dimensions 


Abstract In this chapter, we present the solution of physics problems defined on 
a space-time domain with three and two spatial dimensions. The objective is to 
leave the reader in a position from which it will be possible to tackle state-of-the- 
art problems. The three representative problems in three spatial dimensions involve 
the wave equation, Schródinger equation, and Euler equations. At the end of the 
chapter, we present examples with the 2+1 diffusion equation. 


Keywords 3-1 Partial differential equations - Wave equation - Schrödinger 
equation - Diffusion equation 


In this chapter, we present the solution of physics problems defined on a space-time 
domain with three and two spatial dimensions. The objective is to leave the reader 
in a position from which it will be possible to tackle state-of-the-art problems. The 
three representative problems in three spatial dimensions involve the wave equation, 
Schródinger equation, and Euler equations. At the end of the chapter, we present 
examples with the 2+1 diffusion equation. 


6.1 General Problem 


In previous chapters, when using finite volume or finite difference discretizations, 
we defined the same numerical domain. We proceed in the same manner here. In 
this section, we define a general domain that will be used during the whole chapter 
and also develop various general formulas that will be helpful. 

We will define a general IVP on the domain D = [Xmin, Xmax] X [Ymin, Ymax] X 
[Zmin: Zmax] X [0, tf] and the discrete domain Dg in a more general but similar way 
as before. The discrete version of the domain will be written in Cartesian coordinates 
and defined as Dg = ((xi, yj, Zk, t”)}, where 


Xi = Xmin +i Ax, 
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Yj = Ymin + JAY, 
Zk = Zmin + kAz, 
t" = nAt, (6.1) 


and labels take values i = 0,..., Nx, j = 0,..., Ny, k = 0,..., Nz, and spatial 
resolutions are defined by Ax = (Xmax — Xmin)/ Nx, AY = (Ymax — Ymin)/ Ny, 
Az = (Zmax — Zmin)/Nz. Time resolution is set to At = C min(Ax, Ay, Az) in 
order to take the smallest value in terms of spatial resolutions. This is formal, and in 
the examples here, we will always use Ax = Ay = Az. 


6.1.1 Expressions for Partial Derivatives 


In problems involving three spatial dimensions and time, 3+1 dimensions from now 
on, one has to define discrete versions of partial derivatives. For this, we will denote 
a generic function f = f(x, y, z, t) at the arbitrary point (xi, yj, zx, t”) € Da by 
Lue 

In 3+1 dimensions, one can have four partial derivatives, whose discrete versions 
are extensions of the expressions we derived in Sect. 3.1 using Taylor series 
expansions, this time along each of the spatial direction and time. Here, we 
summarize the expressions for the various first-order partial derivatives of the 
generic function f. 

First-order derivatives and second-order accurate, centered at (xi, yj, Zk, t"), 
follow directly from expressions (3.5) and (3.15): 


= zio dea. O(Ax?) (6.2) 

ax (Xis yj zie t") 2Ax , 1 

- Mu oro + O(Ay’) (6.3) 

dy Xis yj zi t") 2Ay x , À 

af pur a fia n? , 

ae ne T OTUBENATN 64 

dz iYi Zk t") 2Az tO(Az) (6.4) 
n4l n-l1 

ðt (Xi y j zie.) 2At , 


whereas forward and backward one-sided formulas (3.7), (3.8), (3.16), and (3.17) 
are generalized. For example, the expressions for first-order partial derivatives with 
respect to x 
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n n n 
i+2,j,k Afi i + 3 fi jk 


ə 
af = +O(Ax’), X (66) 
ax (xi y j zik. t") SAX 
3 Pg yo Sor 
af E i-ljk i,j,k + O(Ax?), (6.7) 
Ox (xi y j, zio f?) 2Ax 

Xi yj.zke 


and the derivatives with respect to y and z are analogous, where, instead of the index 
i, indices j and k need to be shifted in each term of the expressions. 

Among the one-sided expressions for the derivative with respect to t, we need 
the backward version, which is a generalization of (3.17): 


4 JE? = 4T 3p3 n 
x = AIA EH A out, (6.8) 


(Xi, yj zie t") 
j 


for all i, j, and k. 
Centered second-order derivatives, second-order accurate follow from (3.9) 
and (3.18): 


92 l'as 2 2g Ty 

ze _ JE i IZLIK L O(Ax?), (6.9) 
X Gi y j zio t") ^ 

92 fik Sije t Sij- 

a MENU. n iíj-lk + O(Ay’), (6.10) 
dy Gi yj zie t") Ay 

92 fija 7 Mot Fie 

yf — Jijk+l a RAE 1 O(Az®, (6.11) 
dz Gi y j zi t") Az 

z i-o pee 

a E TE OAT, (6.12) 
ðt Gri yj. zie t") At 


which will be useful too. 

Each of the examples of IVP in this chapter will have its own initial and 
boundary conditions that we will define. These problems will be the generalization 
of problems solved in 1+1 dimensions from previous chapters. 


6.1.2 Programming 


In 3+1 evolution problems, the solution will be constructed via the time evolution 
of functions that depend on three independent spatial variables. The collection of 


all values of the generic grid function f; jk defined at (xi, yj, Zk, t”) € Da will be 


stored in a three-dimensional array f, whereas at time t”~! in the array £. p: 
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real(kind=8), allocatable, dimension(:,:,:) :: f£,f p 
and the allocation of memory would read 
allocate(f(0:Nx,0:Ny,0:Nz) , £ p(0:Nx,0:Ny,0:Nz)). 


For ease of programming, we will also declare spatial coordinates x, y, z as three- 
dimensional arrays, which will also facilitate the output. 


Output. Unlike in 1+1 problems, where a grid function is one-dimensional, it was 
easy to visualize the numerical solution because the output was the whole collection 
of entries, whereas in 3+1 problems one cannot easily visualize all the components 
of the arrays. We write simple routines that produce the projections of a grid function 
along each of the three axes x, y, z or the projection of a function on the xy, xz, yz 
planes. 


In the problems of this chapter, we will output projections of the function f : 
along the axes that pass through the center of the domain, which are f7' 'Ny/2,Ne/2 tor 
i=0,..., Ny along the x—axis, FN D. i NA for j = 0,..., Ny along the y—axis, 
and fw. 2, Ny [2k fork =0,..., Nz along the z—axis. 

The projection of f7'; " jk N the plane parallel to the xy—plane that passes through 
the center of the doman is also useful and can be done by saving the 2D array 
fi iN. LNUA fori = 0,..., Ny and j = 0,..., Ny. Similarly, the projection of "nm 
on the plane passing roih the center of the domain parallel to the yz— plane i is 
FN Ne /2, j.k for j = 0,..., Ny and k = 0,..., Nz and the projection of fr j9na 
plane that passes ihroush the center of the domin and is parallel to the xz— plane i is 
SiN, /2.k fori =0,..., Ny and k =0,..., Nz. 

These projections will allow us to have sufficient information for the analysis of 
the numerical solutions. 


Exercise. At the faces of the domain x = Xmjn and x = Xmax, centered 
finite differencing formulas (6.3) and (6.4), for first-order partial derivatives 
with respect to y and z directions, can be used. However, partial derivatives 
along x need one-sided formulas. Write down such formulas based on the 
construction of (3.7) and (3.8). Write also the formulas for first-order partial 
derivatives with respect to y and z, to be used at the faces y = ymin. Y = Ymax 
and z = Zmin, Z = Zmax, respectively. 
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6.2 The 3+1 Wave Equation Using a Simple Discretization 


We now solve the 3+1 wave equation in Cartesian coordinates. This problem can 
be solved using either the simple finite differences method of Sect. 3.2, the implicit 
method of Sect. 3.3, or the method of lines of Sect. 4.4. As done before, we first 
define the IVP in the continuum, construct its exact solution, and then proceed to 
construct the numerical solution with different methods. 

The IVP in the continuum is defined as follows: 


a2 a? a2 a? 
d ma x i S9 $ =p, yz t) 
D = [Xmin, Xmax] X [Ymin: Ymax] 
X [Zmin; Zmax] X [0, ty] Domain (6.13) 
$ (x, y, z, 0) = do(x, y, z) Initial Conditions 
$x, y, z, 0) = do, y, z) 
$ (8D, t) Boundary Conditions 


Like in the 1+1 case, we impose Cauchy boundary conditions at the side (x, y, z, 0) 
of the domain, corresponding to a time-symmetric Gaussian pulse centered at the 
origin: 


pola, y, z) = Ae- C Xa? (6.14) 
olx, y, z) = 0. (6.15) 


Notice that the initial pulse is spherically symmetric, because $o(x, y, z) depends 
on r = yx? + y? + z?. We choose this profile because it is the generalization of 
the 1+1 problem, for which we can calculate the exact solution to compare with and 
also illustrate the properties of a spherical wave. 


6.2.1 The Exact Solution 


For the exact solution of this particular IVP, we rewrite the equation in spherical 
coordinates, knowing that the wave function with the spherical Gaussian initial 
conditions will propagate spherically is such that $ (x, y, z, t) = $(r, t): 


09 dap 2909 _ 
Ət? Ər? rər — 


0, (6.16) 


by defining the auxiliary variable ọ = rø, this equation transforms into the 
following one: 


1fap dao 
eg |e mee. rmt 6.17 
r | 0t? 24 i.n 
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Let us find a solution for r > 0. This equation has a general solution of the type 
yg = g(r +t) + h(r — t) with g and h generic functions of class C?. Now, let us 
introduce time-symmetry $ = 0 at initial time, which implies that ¢ = 0, which in 
turn implies that o = g’ — h’ = 0, whose simplest solution is g = h. If we propose 


an initial form of g(€) = Seg t 10 pas. where € = r + t, we have the following 
solution for all times: 


A A 
eit) — srt te € HY o? 4 = t)e- 0-0 fe? (6.18) 


Then the solution for the original $ and its initial profile read 


lm oor? Jo? 125959 t) e Do? 
t3 r 


ó(r, t) = (6.19) 


$(r,0) = Ae "e, (6.20) 


where r = yx? + y? + z?. 

Now the solution at r = 0. Notice that the factor in brackets of (6.17) is zero if one 
substitutes (6.18), which would possibly compensate the singularity when r — 0. 
One can check that solution (6.19) is regular at r = 0. For this, we expand the 
solution (6.19) around r = 0: 


$600 ire PI + Ae tI? 


A 4 t* 2 
*&|- oO 24 47? -fale 10724 (y^), => 


2A 27-2 
$(0, 1) = —S Pe Ie 4 Ae I, (6.21) 
oO 


which shows that the result is regular at r = 0. The exact solution is therefore the 
expression (6.19) for r > 0 and (6.21) for r = 0. This is the exact solution in the 
whole domain IR? x R and is used here to compare with the numerical solutions to 
be constructed in a finite domain. 


6.2.2 Numerical Solution Using a Simple Discretization 


We denote the value of ¢ at the generic point (xi, Yj, Zk, t") of the numerical domain 
Da by $; jk The discrete version of the initial conditions is written exactly in the 
same manner as in the 1+1 case. The wave function at 1? is the Gaussian pulse 
itself (6.14). However, the time-symmetric condition on the time derivative (6.15) 
has to be implemented using a virtual time t~! = £t? — At, where we define 
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appropriate values of $;- t as in Eq. (3.29). For this, we construct 9; j a as a Taylor 
series expansion along the backward time direction and obtain 


_ ap At? 3° 
ijk =O) jn — At ocu + O(AP), 
ðt Gu. yj. zi.) ðt Gi. yj, zio t9) 
: $ B ES 
time symmetry — — 0 implies 
Gi yj zit?) 
AP ah 3 
$n, =O jet sas + O(A) 
ii "E 2 or Gi. yj zi t9) 
At? [39 ad a 
= OP jet | | + O(AP). 
ij, 2 ax? dy? az2 Qi y js zi t9) 


Therefore, using formulas (6.9), (6.10), and (6.11) and that the resolution is the same 
along the three spatial directions Ax = Ay = Az, the initial conditions are set to 


2 4:52. 2 2 
diu eo COEUR (6.22) 
e 0 
$; ik = ÓLjk 
APT " ; " 
+ FAR [99.54 + Pi-1,j,k + Êi i ELE + Pi. j-1,k 


0 0 0 
TÓi jk + i ja — 865 j| 


+O(Ax?, Ay, Az, At), 


for all interior points of Dg, except boundaries, where one-sided second-order 
derivative operators of the type (6.6)-(6.7) have to be used at each face. 

The evolution is carried out using the discrete version of the wave equation, 
which is constructed using formulas m 2» (6.10), (6.11), and (6.12) into the wave 
equation (6.13) and then solving for gt B " 


AP 
+1 
Pije = AG raga T Pij + Pian 
AP 
uv 26; ik + Pij- 14) 


At? " n—1 
TAS e 7 20; jk RE $i j,k- 1) + 29; j,k — Oi hk 


+O(Ax’, Ay’, Az’, At’). (6.23) 
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Notice that this is a generalization of formula (3.27) for the 1--1 wave equation and 
serves to calculate the solution $ at time t”+! in terms of information at times t” 
and t”—!, Also notice that this formula does not serve to calculate the solution at the 
faces of the spatial domain, which will be determined by the boundary conditions to 
be used. 


Outgoing Wave Boundary Conditions. The initial conditions used here correspond 
to a spherical wave, whereas the boundary is the faces of a cube; thus, the wave front 
is not plane and is not parallel to any of the faces. This interesting situation is very 
common in many problems, and here, we explain the implementation of practical 
wave boundary conditions for a spherical front on a cubic boundary. Knowing 
the pulse is spherically symmetric, notice that the wave operator in (6.16) can be 
factorized, like in the 1+1 case, for outgoing and ingoing spherical pulses assuming 
the origin of coordinates is at r — 0: 


ð 9 1 ð 9 1 
=0. 6.24 
(s or H (žije (oem 


At the boundary, we want to set the inward mode to zero with the intention to avoid 
signals to be reflected back from the boundary toward the interior of the domain, for 
which we have to solve the following equation at the boundary surface: 


0$ 0 


0, 6.25 
Ot or r ( ) 


a condition that needs to be translated into Cartesian coordinates. Using the chain 


E ‘ ‘ .. ð | d¢ dr _ x* ð$ 
rule, the derivative of @ with respect to each coordinate is [> = Fr pt = F RE 


with r = yx? + y? +z? and x* = x, y, z, which implies that a = If for 
x* Æ 0, which is true at any face of the cube. Here, x* is the coordinate whose 
axis is normal to the face one desires to impose the boundary condition onto, which 
reads 


ad r ð$ 0) 


ot xk axk r 


= 0, (6.26) 


and r is evaluated from the origin of coordinates to each point of the cube’s face 
perpendicular to the x^-axis one deals with. 


Explicitly, for the face of the boundary on the plane x = Xmax, the discrete 
version of Eq. (6.26), using the second-order accurate backward one-sided first- 
order time derivative (6.8) and second-order accurate backward first-order space 
derivative (6.7), for all points (xw, , yj, Zk, t"), and the radius evaluated at each point 


of the face ry, j,k = |J X. T y + A one obtains 
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n—l n n4l n4l m n+1 
ỌN, jk z APN, j.k a BØN. jk 2 YN. j,k $2 Ek gi 4v —1,j,k + BØN, j.k 


2At XN, j,k P 
n4l 
4 Ne FN k =0 
T nis j,k 


for all j, k. One solves for eut. jp Which is the value of the wave function at each 


point of the boundary plane x = Xmax = XN,: 


ou = ! 
Ny, j,k 34 3 Meky 1 
2At 2AX XN, j.k TNx, j,k 


4d, ., — n-l eure _ 4grt! . 
7 ON, jk ỌN, j,k YN. jk 2, j.k Ny—1,j.k (6.27) 
2At XN, j,k 2Ax 


A similar calculation leads to the value of the wave function at the face where x — 
Xmin; that is, for all points (xo, yj, zx, t") of the numerical domain: 


+1 +1 
gel 1 466 i , — Po Pr pi Pik — 401 jk 
0, j,k ( 3 3 rojk 4 01 ) 2At XQ, j,k 2Ax 


2At 2Ax XO, j,k TQ, j,k 


(6.28) 


where ro, j,k = (us + y? + zi 
Similar expressions have to be constructed for the faces on the planes y = Ymax, 
Y = Ymin, Z = Zmax and Z = Zmin Of the spatial boundary of Dg. 


Let Us Workout an Example. Consider the domain D = [—1,1] x [—1, 1] x 
[-1, 1] x [0, trl, With Xmax = Ymax = Zmax = —Xmin = —Ymin = —Zmin = 1 
and tf = 2. The discrete domain Dg is defined according to (6.1) with Ny = 
Ny = N; = 100 or equivalently Ax = Ay = Az = 0.02 and At = 0.5Ax. The 
parameters of the initial Gaussian (6.14) are set to A = 1 ando = 0.1 


Snapshots of the numerical solution are shown in Fig. 6.1. Notice that unlike the 
1+1 case, the amplitude of the pulse decays as a spherical wave ^ 1/r. The com- 
parison of the numerical solution with the exact solution (6.19) and (6.21) appears 
in Fig. 6.2, where also the second-order convergence according to formula (3.21) is 
shown, in agreement with the accuracy of the operators and time integration. 

The code that produces these results WaveSimple3p1.f90 is found in the 
Electronic Supplementary Material. 
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Fig. 6.1 Numerical solution ¢ of the 3+1 wave equation projected on the xy— plane at times t = 
0, 0.3, 0.6, and 1.5. Notice that the wave gets off the domain showing the outgoing wave boundary 
conditions work fine. Since the pulse is spherically symmetric, the projection on the yz and zx 
planes has the same results 


6.2.3 Example with Sources 


Let us consider a nonspherically symmetric scenario. For this, we will slightly 
complicate the wave equation and add a source. The IVP to solve is based on the 
problem (6.13) with the following wave equation: 


ah ao 9 ah 


ar2 sa y) a? 


= S(x, y, Z, t), (6.29) 


where S is a source. We will construct a source consisting of two scalar charges 
orbiting around each other defined by 


S = Aye x9) yo)? z Mog. 4 A,e le xo)? +(y+y0)? 221/02 (6.30) 


which is the sum of two Gaussians of amplitude A; and width os, centered at 
the points (xo, yo, 0) and (—xo, — yo, 0). We make the charges orbit on the circle 
of radius rs with angular frequency w by assuming xo = rs cos(wt) and yo = 
rs sin(ot). 


6.2 The 3+1 Wave Equation Using a Simple Discretization 


0 
x 


Fig. 6.2 At the top, we show the solutions, numerical on the left and exact on the right at various 
times, projected along the x—axis. At the bottom, we show the error along the x—axis at t = 0.3 
and t = 0.6. Additionally, we show the error of the numerical solution using double resolution, 
and the result indicates second-order convergence, in agreement with the error of the methods 


The discrete version of this equation leads to the following expression for the 


wave function at inner points of Dg: 


At? 
ntl... n n n 
ek Ax (Pint je 29; pe iig 


AP n n n 
VAY HR — 26; jk T 9,1) 


Ar -1 
Ag Gian T 205 jk + PF LL) E205. Dijk 


+S; jk AP + O(Ax?, Ay”, Az”, At?), 


which is Eq. (6.23) plus the contribution of the source. 


(6.31) 


The initial conditions are $(x, y,z,0) = S(x, y, z, 0), and time symmetry is 
assumed. For the construction of the wave function at the auxiliary time t~!, we 


follow the second expressions of (6.22). 


We impose outgoing wave boundary conditions following the recipe above, 


from (6.26) to (6.28). 
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Fig. 6.3 Wave function at time t = 3, 6, 9, 12. The result is that the two orbiting sources produce 
a tail left behind 


For this case, consider the same domain of the previous example, that is, D = 
[—1, 1] x [-1, 1] x [-1, 1] x [0, tfl, with Xmax = Ymax = Zmax = —Xmin = 
—Ymin = —Zmin = l and tf = 2. The discrete domain Dg is defined according 
to (6.1) with Ny = Ny = N; = 100, or equivalently Ax = Ay = Az = 0.02 
and At = 0.5Ax. The parameters of the source in (6.30) are set to A, = 5 x 103, 
o = 0.05, r; = 0.3, and o — 5. 

Snapshots of the solution are shown in Fig.6.3. The sources orbit around the 
origin and leave a trace behind. In pioneering works, this type of numerical 
experiment was once considered a toy model for the generation of gravitational 
waves by binary objects [1], prior to the numerical solution of the binary black hole 
problem in 2005 [2]. 

In the code, the source is incorporated easily within the loop that updates the array 
of $"*! as follows: 


! Update of the wave function 
do i-1,Nx-1 
do j-1,Ny-1 
do k-1,Nz-1 
source(i,j,k) - amp source x exp( -((x(i,j,k)-rad 
*cos(omegast))*))*2 & 
+ (y(i,j,k)-rad«sin(omegaxt))»**2 & 
z(i,j,k)*««2) / sigmax«2 ) & 
amp source * exp( -((x(i,j,k)«rad«cos(omegaxt))**»2 & 
(y(i,j,k)«rad«sin(omega«t))*x*x2 & 
z(i,j,k)*x«2) / sigmax*2 ) 
phi(i,j,k) = dt««2 * ( phi p(i«1,j,k) - 2.0d0«phi p(i,j,k) + 
phi p(i-1,j,k)) / dxx«2 & 


" 
" 
" 
+ 
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+ dt««2 * ( phi p(i,j«1,k) - 2.080xphi p(i,j,k) + 
phi p(i,j-1,k)) / dyx«2 & 
+ dtx*2 * ( phi p(i,j,k4«1) - 2.0d0«phi p(i,j,k) + 
phi p(i,j,k-1)) / dzx«2 & 
+ 2.000 * phi p(i,j,k) - phi pp(i,j,k) + dt**2*source (i,j,k) 
end do 
end do 


end do 


6.3 The 3+1 Wave Equation Using the Method of Lines 


The IVP problem is the same as that in (6.13). In order to apply the method of 
lines, one has to convert the wave equation into a set of first-order PDEs. For that, 
we follow the same strategy as in Sect. 4.4, which consists in defining first-order 
variables: 


296 yp V ay _ ae 
T = Vs = a Weg Loiret (6.32) 


In terms of these variables, the problem (6.13) is redefined as follows: 


dn = Ox Vy + dy Wy + OU. 


Qr yr, = Ox 
Wy = Oy 
Qr V. = 027 
ab = 7, $ — $605. yz t), Vx = x(x, y, z, t) 


Vy = Vy yz t), Wz = WO, yz t), m m m y, Z, f) 
D = [Xmin, Xmax] X [Ymin: Ymax] X [Zmin: Zmax] X [0, tf], Domain 
(x, y, z, 0) = $o(x, y, z) 
Vx (x, y, z, 0) = Wrox, y, z) 
Wy, y, z, 0) = Wyo, y, z) 
W(x, y, z, 0) = Yz Qx, y, z) 


a(x, y, z, 0) = zto(x, y, z) Initial Conditions 
$(9D,t), Vx(9D,t), Vy(9D,t), v;(9D,t), m(0D,t) Boundary Conditions 
(6.33) 


It is a problem of four unknowns wy, Wy, V, anda with the constraints Yy = 0,4, 
Wy = 0,9, and Yz = 0,@. The reconstruction of the original unknown ¢ is achieved 
via the integration of the equation 9; = 7r. 
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All five variables are defined in the numerical domain Dg, and the semi- 
discrete version of the evolution equations in problem (6.38), at the inner points of 
the numerical domain Dg, using second-order accurate expressions for first-order 
spatial derivatives in (6.2)-(6.4), read: 


O Wxi+l, jk — Vx ini jk 2 Vy ijtik — Wy ij-lk 


dð 
d 2Ax 2Ay 
P ij eel — Ve i jl + OCAx^, Ay’, Az’), 
2Az 
Wi+1, j,k — Wi-1, j,k 
Ye = TE + O(Ax?), 
Ti, j+1,k — Wi, j— lk 
Qryry = = T Oey 
P 
à V. = Tu aS FO, 
T N (6.34) 


The integration of the system at the boundary has to be implemented based on 
boundary conditions. 


Time Integration. For time integration, the second- (4.4) or third-order (4.5) 
accurate Runge-Kutta integrators suffice for the solution of this problem. 


6.3.1 The Time-Symmetric Gaussian Pulse 


This example uses the exact solution (6.19) and (6.21) to compare with. In terms 
of the first-order variables, the Cauchy initial conditions (6.14)-(6.15) become 
Dirichlet for all variables at the cube (x, y, z, 0): 


$o(x, y, z) = Ae THH? 


2x 

Wrox, y, z) = =z vol, y, z), 
2y 

Yyolx, y, z) = Z730, y, z), 


2z 
Wo(%, y, z) = -331900. yz) 


mo(x, y, z) = 0, (6.35) 


where time symmetry is implemented simply through the value of zo. 
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Outgoing wave boundary conditions need the Eq.(6.26) to be solved at the 
faces of the spatial boundary of Dg. This is achieved as follows: (i) impose the 
condition (6.26) on $ by defining the appropriate right-hand side for the evolution 
of $ at the faces of Dg; (ii) with the values of $, calculate the space derivatives 
89/8x! = vj, i = x, y, z using one-sided formulas (6.6)-(6.7) and the equivalent 
formulas for the faces perpendicular to y and z axes, at each face; and (iii) finally 
calculate mz = 0¢/dt from (6.26) at all faces. 

Specifically, the boundary condition at the faces where x = Xmin and x = Xmax 
is implemented as follows: 


(i) The semi-discrete version of (6.26), which uses formulas (6.6)-(6.7) at these 


two faces, reads : 


1 2, 5,4 — 461, jk 3do,k rok — Qo k 
E) 
2 Ax XQ, j,k TQ, j,k 


9:Plo, j,k = 


1 On, -2, j,k — 4ON,-1, jk + 3ÓN TN i — ONSE 
, 
2 Ax XNSjk  TNy,j,k 


IO | Ny, j,k = 


for all j, k, that one programs in the calculation of the right-hand side of the 
evolution equation for $. 

(ii) Now that ¢o, j,k and $yw,.;., are known, the value of y, at the faces can be 
calculated using the one-sided formulas (6.6) and (6.7): 


1 2, j,k — 401, j,k + 300, j,k 


Wx0, j,k = 2 Ax 
m 1 óN,—2, j,k — 40N,-1, jk + 3ÓN, j,k 
fis S Ax 


(iii) Finally, using directly condition (6.26), one obtains z as follows: 


TQ. j,k PO, j,k 
TO, j,k = — Wyo, j,k =, 
XQ, j.k TO, j,k 
Ny, j,k Ny, j,k 
TON, j,k = wen Wr Ny jik — S. -— 
Ny. j,k Ne j,k 


The implementation of this boundary condition on the other four faces of the 
boundary is analogous. 

The solution for the initial Gaussian pulse with the same parameters as in the 
previous section is shown in Fig. 6.4. The results are similar to those obtained with 
the simple discretization in Fig. 6.1, except for a bump at the center that remains in 
the domain even if the pulse has gone out of that zone. 
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Fig. 6.4 Numerical solution ¢ of the 3+1 wave equation projected on the xy— plane at times t = 
0, 0.3, 0.6, and 1.5. This time, we use the method of lines, and the plots can be compared with those 
in Fig. 6.1. Notice the bump left at the center of the domain, which is a remnant that converges to 
zero with resolution 


In Fig. 6.5, we show the projection of the solution and the error along the x — axis, 
which should be compared with results in Fig. 6.2. The convergence test using two 
resolutions Ax — 0.02, 0.01 shows that the error bump at the center converges to 
zero with resolution. 

The effort invested in solving the wave equation with the method of lines seems to 
be not retributed, since the solution shows glitches, the error is bigger in magnitude 
than with the simple discretization, and moreover, one has to define four extra 
variables to solve the system of equations, which in turn represents a cost in memory 
and number of operations. Nevertheless, the use of the method of lines pays once the 
systems of equations become more complex as we will show later in this chapter. 


6.3.2 Example with a Plane Wave 


A special case is the evolution of a plane wave of the type $ = exp[i(k - x — ot)], 
where k = (kx, ky, kz) is the wave vector, w the angular frequency of the wave, and 
X = (x, y, z) the position vector in space. From the wave equation 929/81? — V?$ = 
0, the substitution of $ implies the dispersion relation w? = k - k = k2 + k? + g. 


Domain. We solve the equation in the domain D = [—1, 1] x [-1, 1] x [-1, 1] x 
[0, trl, with Xmax = Ymax = Zmax = —Xmin = —Ymin = —Zmin = 1 and ff = 2. 
The discrete domain Dg is defined according to (6.1) with Nx = Ny = N; = 100 
or equivalently Ax = Ay = Az = 0.02, and At = 0.5Ax. 
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Fig. 6.5 Solution $ using the Method of Lines. At the top, we show the solutions, numerical on 
the left and exact on the right, projected along the x—axis. At the bottom, we show the error along 
the x—axis at f = 0.3 and t = 0.6. Additionally, we show the error of the numerical solution using 
double resolution, and the result indicates second-order convergence, in agreement with the order 
of accuracy of the discrete version of space derivative operators and time integration 


Boundary Conditions. In this case, we use periodic boundary conditions, so that 
the wave can travel through the domain indefinitely. 


Unlike in the 1+1 problems, for example, in Sect. 4.4 for the wave equation, 
where periodic boundary conditions involve only two points and the calculation of 
the right-hand sides is simple, as seen in Eqs. (4.16) and (4.17), in the 3+1 case, 
the spatial boundary consists of six faces, and these boundary conditions are not as 
easy to implement. A common solution consists in the definition of ghost points, 
which are extra points outside of Dg where the evolution is carried out like in the 
interior points, but the values of variables at these points are identified with those at 
the opposite face. Explicitly, for any grid function u, memory is allocated for points 
(xi, yj, zi, t”) fori = —1,0,..., Nx, Nx +1, j = —1,0,..., Ny, Ny + 1 and 
k = —1,0,..., Nz, Nz + 1, with an extra cubic surface of points outside of Dj. 
These ghost points allow the calculation of space derivatives up to the faces of Da, 
X = X0, X = XN,» Y = Y0, Y = YN, Z = Zo, and z = Zy,. Then, after each time step 
within the time integrator, RK2 or RK3, one identifies the values of u at the ghost 
faces with those at the opposite face. Explicitly, 
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U0, j,k = UN, j,k UN, +1, jk = U1, j,k 
Ui,0,k = Ui,Ny,k Ui, Ny+1,k = Ui,1,k (6.36) 
Uui, j0 = Ui, j, N; Ui, j,N;+1 = Ui, j,1 
which automatically changes the topology of the domain from a cube into a three- 
torus. 
Initial Conditions. We choose the phase of $ such that at initial time it is real and 
expressions for all the variables at initial time read 
$o(x, y, z) = cos(kyx + kyy + kzz — ot)|1=0, 
VxoGr, y, z) = —kx sin(kyx + kyy + kzz — ot)|1=0, 
Wyo(x, y, z) = —ky sin(kyx + kyy + kzz — ot)li-o; 
Vzo(x, y, z) = —kz sin(kyx + ky y + kzz — ot)|i—o; 
zQ(x, y, z) = wsin(kyx + kyy + kzz — ot)|i—o. (6.37) 
As an example, we set initial conditions for a wave that travels along a diagonal of 


the xy— plane, for which we use a wave number with ky = ky = 27, k; = 0. The 
results of the evolution are shown in Fig. 6.6. 


The code MoLWave3p1 . £90, listed below, solves the 3+1 wave equation using 
the method of lines, for the Gaussian pulse and the plane wave. The code illustrates 


Fig. 6.6 Numerical solution of the 3+1 plane wave projected on the x y —plane at times t = 2, 4, 6, 
and 8 
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the programming of the methods in 3+1 dimensions, along with the implementation 
of outgoing wave and periodic boundary conditions, and is available as Electronic 
Supplementary Material. 


Exercise. Construct the exact solution for a stationary wave in a cubic box. 
Then modify the code, with special care on the boundary conditions to be 
used, and verify that the solution is truly stationary during the evolution. 


6.4 The 3+1 Schrédinger Equation Using the ADI Scheme 


In Cartesian coordinates, the general three-dimensional Schródinger equation reads 


j99 00 — _lyew (x, t) + VX (x, f) V = W(x, y,z,0) 
D = [Xmin, Xmax] X [Ymin: Ymax] X [Zmin, Zmax] 
x[0, ty] Domain 
V (x, y, z, 0) = Yo, y, z) Initial Conditions 
V (0D, t) Boundary Conditions 
(6.38) 


The solution can be constructed with extensions of the strategies used for the 
one-dimensional case. In this section, we describe the extension of the implicit 
Crank-Nicolson method, for which we consider v. ç 18 the wave function at point 
(xi, yj, Zk, t") € Da. Generalizing the development in Eqs. (3.72)-(3.74) to three 
spatial dimensions, the method for the evolution of the wave function from time f" 
to time ż”+! is constructed as follows: 


1 
pet + sib wn, At = wi, k <i, At = 
y^tl yr. 1 
PE NE: ^ i 
= At Mx 2 Loue a Aw | . (6.39) 
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This formula is Schródinger equation with the spatial part averaged at 
times t” and t”*+!, the essence of the Crank-Nicolson method. Notice also 
that the time derivative in (6.39) is second-order accurate centered at the point 
(xi, Yj, zk EU. 


ADI Method. The Alternating Direction Implicit (ADI) method assumes that the 
evolution from t" to t"*! can be implemented by applying the Hamiltonian operator 


NS NE E +V 
|  2\ax2 ay az? 


in four successive steps, one for each of the partial second-order derivatives along 
each direction and one for the potential as follows: 


i n+l i 
(: PA v) pum (1 - 4t v) Ti jk (6.40) 


where Ri, j,k» Sj, j,k, and T;, j y are auxiliary arrays that store the values of the wave 
function after applying the derivative operator along each of the spatial directions. 


The implementation of the ADI method is based on the fact that each line 
in (6.40) defines a tridiagonal system as found for the one-dimensional case in 
Sect. 3.5. In particular for the interior points of the numerical domain, using centered 
discrete expressions for the second-order partial derivatives, these tridiagonal 
systems are explicitly 
(—o) Ri-1, j,k + + 20) Ri, j,k + (70) Ria jk = (VP gy 

H — 207, t + (0 jk 
(—@)S;,j-1,4 + (1 + 20) Sj, jk + (—0)Si, j+1,x = (0) Ri, j-1k 

+(1 — 2a) Ri, j.k + (à) Ri, jl. 
(—0)Ti, j.k—1 + (1 + 2a)Ti, jk + (0) Ti, jk = (0) Si, j k-1 

+(1 — 2a)Si, jk + (@) Si, j,k+1 


"S 1 — BV; jk 


jk = Ti. jk 6.41 
ik 1X BV) i i,j,k (6.41) 


_ 1; At _ l; 
where œ = JA and B = jiAt. 
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These formulas are valid in general for inner points, whereas the formulas at the 
faces of the domain depend on the boundary conditions imposed. In what follows, 
we work out the case of the particle in a box and the particle in the harmonic 
oscillator potential that illustrate two types of boundary conditions. 


6.4.1 Two Exact Solutions 


Before describing the construction of numerical solutions, we present the exact 
solution for the two basic problems, the particle in a box and the particle in a 
harmonic oscillator potential. 

These two solutions are stationary, which allows us to start their construction 
together, noticing that in the two cases the potential is time-independent and 
Schródinger equation reads 


OW (x, t) 
1——— = 


S -i vva, t) V()V (x, t), (6.42) 


that can be separated assuming W (x, t) = Y (xX)T (t), which implies that 


prem : Vy EVE 
1——— = - x)= , 
T dt 2y 


where the separation constant is the energy E like in the 1+1 case, which allows one 
to determine the time dependence of the wave function T = Toe~'#“—) and the 
spatial wave function y. obeys the stationary Schrödinger equation: 


- SVU Voy = Ev. (6.43) 


Without loss of generality, one can set Tọ = 1 because the solution will be later 
normalized and to = O as the initial time for the evolution of the wave function. 
From now on, the particular solutions will depend on the potential V (x). 


6.4.1.1 Particle in a 3D Box 
We will use a unitary square box, where the potential is defined by 
0, X € [0, 1] x [0, 1] x [0, 1] 


V(x)- (6.44) 
oo, otherwise, 
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which reduces Eq. (6.43) to 


y y day 
2Ey — 0, 6.45 
0x? i dy? T x) y ain 


Vy +2Ey = ( 


with y = 0 at the boundaries of the box [0, 1] x [0, 1] x [0, 1]. The solution is con- 
structed by a further separation of variables assuming W(x, y, x) = X(x)Y(y)Z(z) 
and finding X,,(x) = «2sin(nyzx), Ya,(y) = V2sin(nyzy), and Zn, (z) = 
A2 sin(nzrz), with nx, ny, and n; integers. Applying the boundary conditions and 
the normalization condition 


1 1 1 
N= Í f ri V*y dxdydz = 1, (6.46) 
0 0 0 


V(x,y,z)-— V8 sin(n,zx) sin(n yz y) sin(nzz z), (6.47) 


the solution is 


where nx, ny, and n; are integers and the energy is quantized 


2 
T 
E= 305 +n, +n2). (6.48) 
Therefore, the time-dependent solution V reads 


V (x, 1) = V GT (t) = V8e (PI? simQn crx) sin(n rry), sin(n7z) 
(6.49) 


whose real part can be used to measure the error of the numerical solution. 


Numerical Solution. As an example, we solve the problem with n, = ny = n; = 3, 
in the domain [0, 1]? using resolution with Ny = Ny = N; = 100 and At = C Ax? 
with C = 1. Initial conditions for the wave function are the expression (6.49) with 
t = 0. In Fig. 6.7, we show the evolution of the wave function and p = |W|?, which 
remains nearly time-independent. 


Diagnostics of the solution includes the conservation of N in (6.46) and the value 
of the total energy E. In order to evaluate E = (H), one can use the expectation 
value of the kinetic energy operator: 


1 1 1 
(M =R = wi- ivo [ f f emassa. (6.50) 


In Fig. 6.8, we show the number of particles N calculated using (6.46), the total 
energy E — (H) calculated using (6.50), and the central value of p (technically the 
infinity norm of p, ||||oo) as functions of time. For comparison, the exact values 
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Fig. 6.7 Projection of Re(W) and p on the plane z = 1/2 at various times, for the particle in a 
three-dimensional box with nx n; —3 
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Fig. 6.8 Number of particles N, energy E — (H), and the central value of p as function of time, 
for the particle in a three-dimensional box with n, = ny = n; = 3 


are, respectively, N = 1 from (6.46), E = x?(3 x 37)/2 ~ 133.23966 from (6.48), 
and o(0, t) = 8 from (6.49). 
6.4.2 Particle in a Harmonic Oscillator Potential 


In this case, the potential is V(x) = 5K (x?+y?+27), and the stationary Schrödinger 
equation (6.43) reads 


2 2 2 
(x y wy 


1 
Ge? ay ae ) + 5a? y! c D) + 2Ey =0. (6.51) 


As we did in the ID case, we define auxiliary constants a = 4/x and b = 2E. 
Definition of new variables £ = ./ax,n = yay, and = yaz leads to the equation 


2 2 2 
(eei) BU evo. (6.52) 


08? aq ag 
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which can be separated via w(E,n,¢) = X(E)Y(y)Z(C), into three Hermite 
equations whose solutions are 


1 2 
Xn, (€) = ij Fern Pg, (E), 
Yn, 0) = | —— eH, C) 
E JTN! Sins 
1 -pm 
Zn. (£) = Tarand? Hn, (¢), 


where the energy is quantized as follows: 


3 
En, nya —ny-d ny +n + 7 (6.53) 


Therefore, the fully time-dependent solution reads 


Yx, y, z, t) = : g bE nx ny net 
T S 7 :3/22nx Vy Dig any In! 


xe 0 Pg. (x) H, (y) Hs (2), (6.54) 


which can be used to initialize the evolution and to calculate the error of numerical 
solutions. 


Numerical Solution. As an example, we solve the problem with n, = n, = n; = 2, 
in the domain [—5, 5]? using resolution with Ny = Ny = N, = 100 and At = 
CAx? with C = 1. Initial conditions use the exact solution (6.54) with t = 0. 
In Fig. 6.9, we show the evolution of the wave function and that p remains nearly 
time-independent as expected. 


Unlike (6.50), the expectation value of the Hamiltonian involves now the 
potential energy 


E = (YJ ÂY) 


1 1 1 1 1 
=w- evi) | / i v* | ——V?v | - Vvw*v | dxdydz. 
2 o Jo Jo 2 


(6.55) 


In Fig. 6.10, we show the number of particles N calculated using (6.46) and the total 
energy E — (wÊ |W) calculated using (6.55). For reference, the exact values are 
N = 1 and the energy, according to (6.53), is E = 2 +2 + 2 + 3/2 = 7.5. 

The code that implements these methods and solutions Schroedinger3p1.f90 
can be found in Appendix B. 
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Fig. 6.9 Projection of Re(V) and p on the plane z = 1/2 at various times for the three- 
dimensional harmonic oscillator with ny = ny = n; = 2 
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Fig. 6.10 Number of particles N and energy E as function of time, for the three-dimensional 
harmonic oscillator with n; — ny — n; —2 


Exercise. Another way to monitor the energy is to track the oscillation of the 
wave function, for example, saving the central value of Re(W) as function 
of time and then calculating its Fourier transform (FT). The FT should have 
a dominant peak of frequency E = ny + ny + nz + 3/2 for the harmonic 
oscillator potential. Show this is the case for the example worked out in the 
text with n, = ny = n; = 2. 


6.5 3D Hydrodynamics 


The dynamics of a compressible inviscid fluid is ruled by the three-dimensional 
Euler equations. The IVP in this case reads 


0;p + V- (pv) 20 

9/(ov) + V. (v8 pv) + Vp = —ovVó 

dE -- V - [GE + pv] = —ev- V6, p = pQ, t), p = p(x.t), 
v= v(x, t), E = E(x, t) 


D = [Xmin, Xmax] X [Ymin, Ymax] (6.56) 
X [Zmin, Zmax] X [0, tr] Domain 
p(x, 0) = po(x), p(x, 0) = po), Initial Conditions 


v(x, 0) = vo(x), E(x, 0) = Eo(x) 
p(dD,t), p(dD,t), v(0D,t), E(AD, t) Boundary Conditions 
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where each volume element of the fluid has density p, velocity v, pressure p, internal 
energy e, and total energy E — pv? + e). This is a five-equations system for six 
unknowns p, v, p, and e or E and is closed using an equation of state (EoS). We 
have written additionally the contribution of an external force represented by the 
potential $, acting on each fluid element. In general, all variables involved depend 
on time and space. 

The strategy to solve this IVP is essentially the generalization of that used for 
hydrodynamics in 1+1 dimensions, for a bigger system of equations: 


— The system of equations in (6.56) for the primitive variables p, p, v, and E 
is transformed into a set of flux balance equations for conservative variables 
u1,U2, U3, U4, andus. 

— Initial conditions are set for this IVP on primitive variables and then define initial 
conditions for the conservative variables. 

— Evolve the equations written in flux conservative form using the finite volume 
method using suitable boundary conditions. 

— Recover the primitive variables for the next evolution step and output. 


We tackle the problem with no symmetries in Cartesian coordinates. To start with, 
notice that the second equation in (6.56) represents the conservation of momentum 
density along the three spatial directions, and it is worth expanding its flux. 
Considering that the velocity field has components v = (vx, vy, Uz) 


Ux UyUy UxUy UxUz 
V@pv=| vy | [oUx, QUy, pvz] = P | vyvy vyvy Vyvz |. (6.57) 
v UzUx UzUy UzU; 


and therefore the second of Eq. (6.56) is expanded into the following three 
equations: 


0r (ovx) + V - (Q(vxvxX + vxvy) + vyv;2)) + Oy p = —00,0, 
9j (pvy) + V - (p(uyvx$ + vyvyS + vyv;2)) + dy p = —pdy®, 
8r (pvz) + V - Co(Uzvx3 + vzUy 9 + v;v;Z)) + p = — p3: ®, 
where £, $, and? are the canonical basis vectors of IR?. Expanding the divergence 
operators in these equations and those of mass and energy conservation in (6.56) is 
explicitly the following system: 
dp + 8x (ovx) + 8y(pvy) + à: (pv;) = 0, 
dr (Qux) + Qc (Qux Ux) + Dy (pvxvy) + 4; (PUxUz) + Ix p = —PI®, 
dı (pvy) + 8x (pvyvx) + Iy(PvyVy) + 0: (pvyv;) + Iyp = —pdy®, 
0; (Vz) + Oy (pvzvy) + Oy (PUzVy) + Oz (pvzv;) + 0;p = — dP, 
8 E + 9, ((E + p)vx) + dy((E + p)vy) + 8:((E + p)v;) = —p (v0, 


+vydyP + v,0-®) . 
(6.58) 
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These equations suggest the definition of the conservative variables that we accom- 
modate as 


p ui 
DUx u2 
u= | pry |:— | ua (6.59) 
pvz m 
E us 


and that the system is a set of flux balance law equations, which is a generalization 
of Eq. (5.18): 


du IF) | 3(Fj) aF 
u XE) aE) 300 


S, 6.60 
at ax dy Oz 16:00) 


where F,,F,,andF, are five-component flux vectors along each direction, a 
generalization of Eq. (5.19), along with the source vector: 


D Vx py 
pUxUx + p DUx Uy 
F, = PUy Vx > Fy = | pvyvy+p |, 
D UzUx DUzUy 
(us + p)ux (us + p)v, 
puz 0 
PUx Vz —00,P 
F, = PVyVz , S= —pdy®P : (6.61) 
pU; + p — pz P 
(us + p)v — (v0, 9 + vydyP + v; 0,0) 


For the application of the MoL, one writes the semi-discrete version of the 
system (6.60): 


i pau-/2 p n+1/2 p \2t+1/2 p \2+1/2 
ou — Posie Z PORK Eije 7 (20; ip 
at Ax Ay 
= +1/2 m \nt+l/2 
Eoi p12 — (F5)j i 12 ql 
Zi, j, J, /2 
F + Si jk > (6.62) 


which is a generalization of the one-dimensional case in Eq. (5.16). Notice that the 
flux F, needs to be known at the left and right from an intercell face on the plane 
x = xi, F, needs to be known at the left and right from an intercell face on the 
plane y = yj, and F; needs to be known at the left and right from an intercell face 
on the plane z = zg. This observation allows one to construct the fluxes to the left 
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L and right R from an intercell boundary as we did for the one-dimensional case: by 
considering flux transfer along one of the three directions at a time as we do below. 

Following the one-dimensional case, the construction of fluxes aside an intercell 
boundary requires writing the system of equations using the chain rule and define 
Jacobian matrices. The generalization of (5.20) for the 3D case reads 


ðu  dF,0u dF,ðu dF,0u 
+ +—2_— + = 
at du ox | du ðy du Oz 


S, (6.63) 


where dF, /du, dF, /du, and dF;/du are three 5 x 5 matrices, whereas in the one- 
dimensional case in (5.21) there was only one 3 x 3 Jacobian matrix. Each of these 
three matrices has its own characteristic structure needed for the construction of the 
numerical fluxes in (6.62). 

As we did for one-dimensional problems, we construct numerical fluxes using 
the HLLE formula, which needs the eigenvalues of these Jacobian matrices. This 
requires writing the flux vectors in terms of conservative variables, which in turn 
needs closing the system with an EoS. We again use the ideal gas EoS p — (y — 
1)pe, which fixes the total energy to us — E — pv? Te)- ipv? + reat The 
flux vectors in (6.61) are then 


pu "d 
x 2 2 2 
1 u ] uzt+u 
pUyUvx + p 3 Q dm t v : 1)(us 2 ET 4) 
F, = PVy Ux = E: ; (6.64) 
D Uz Ux e 
(us + p)vx yee T 3Q — DUG + u3 ud 
u3 
es usta 
DUxUy 3 "I 2,12 
+ 
Fy =| ovyo +p | =| 486- +0- Dus -32 |, (665 
ua. 
PUzVy a 
(us + p)vy ye — ay — Deg + u3 + uy) 
u4 
pz u4u» 
D Ux Vz iis 
F.=| pww |= ui . (6.66) 
1 ui 1 uus 
pvzvz + p gay tY- Dus -34r ) 
(us + p)vz ye T 27 - Doo +03 + ur 


The eigenvalues of the Jacobian matrices dF, /du, dF, /du, and dF, /du are needed 
for the implementation of the HLLE flux formula and are 
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. d¥ , 
eigenvalues of da Ay = Ux — Cs, À2 = Ug, À3 = Uy, À4 = Vy, AS 
u 
= Vy + Cs (6.67) 
. dF, 
eigenvalues of du Ay =Vy—Cs, À2 = Uy, À3 = Uy, A4 = Uy, A5 
» j ) 
= vy dc; (6.68) 
. dF, 
eigenvalues of d Ay =V; — Cs, À2 = Vz, À3 = Uz, À4— V, AS 
u 
= V; + Cs (6.69) 


where cs = ~y p/p is the speed of sound for the ideal gas. 

The following step may seem excessively developed; however, it is essential for 
the careful implementation of the method in 3D, and we specify the needed steps 
here. 


Fluxes x. Calculation of (Fy int /2,j.k in Eq. (6.62) uses the following HLLE 
formula for alli = 0,..., Ny — 1 


L R R L 
AG Fy (Qui, 1/2, 5,6) — AF Uy 12,0) T AHA- 4 apo ji T Wo ja) 


FO = 2 
(6.70) 
where à and A_ are generalized from (5.33) to 
àp = max(0, AR, 18, AR, AR, RE CATAL AP AT AD. 
Ac = min(0, AT AT AT ATLAS CAT 15, A5, AF, 18), (6.71) 


with the eigenvalues of dF, /du in (6.67) at left and right from the intercell boundary 
at the plane x — xj: 


Al uaa. AE = vL, APS eg A, dg. = a + GL, 
aR = UxR — CsR, rR = UxR; aR = VxR, aR = VyR, AR = UxR + CSR, 
where 

CsL = V PLY/ PL. 


CsR = J DRY / DR- 
(6.72) 


On the other hand, in Eq. (6.70), the flux is evaluated at APT wh je which 
are the values of the conservative variables reconstructed at the left L and right 
R cells from the interface at x = x;. For the examples in this book, we use the 
Godunov reconstructor (5.35) that along the x—direction for a variable w reads 


290 


inde 
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Te 


or the minmod reconstructor (5.36) that now reads 


L 
Wi; 


F1/2, j,k 


R 
Wi 


-1/2. j,k 


Oj 


minmod(a, b) 


Mi+1/2 


Mj-1/2 


Notice that w is any variable, 


is that we reconstruct the primitive variables p^, v 


-1/2, jk — Wi, jk: 

1/2, jk — Witljk: (6.73) 
= Wi, j,k + Gi (Xi+1/2 — Xi). 
= Wil, jk + O41 41/2 — Xi41), (6.74) 


minmod(mj—1/2, Mi+1/2) 


a 
b 
0 


if |a| < |b| and ab > 0 
if |a| > |b| and ab > 0 
if ab < 0. 
Wit+l, j,k — Wi, j,k 

Xiii 
Wi, jk — Wi—1, j,k 


Xi — Xi—1 


either primitive or conservative. Our strategy here 


L 


x? 


L 


Uy ^ 


L L L L R 
Une Ps @ Ep 


vÈ, i. E, p^, e^, and EP, and from these, we calculate the conservative 
: L iib bios RR 
variables 51/2, jp Uy WS WE Iu) and uf i naci Uy MA WA Rug) needed 


in the flux formula (6.70). Finally, the flux vector Fy, according to (6.64) evaluated 


L R 
at Ur 1 jo Uii, j,k reads 


L 
ua 


L 
Fy (i412, = 


ubuk 
L 
uy 


1 
a3 


- iy - (uh)? + 


MC 


L 
Uy 
(ut? 


+ us Ly. 


+ Gf) 
(6.75) 
u$ 


c » UDHU y 


R 
Fx (uj, 15 j 4) = 


uk uk 
R 
uy 


y 


y) Se e - Duk - $6805 


— 4(y — Yuh)? + UR)? + (u£)?) 


m » 


(6.76) 


which are the expressions used in the HLLE flux formula (6.70). 
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Fluxes y. Calculation of (F y)i,j+1/2,k in Eq. (6.62) uses the following HLLE 
formula for all j = 0,..., Ny — 1 


RAE, = AF, (Up j 14 = AF, (uF (1/54) * AtA- QI a B uL; ioa) 
y7i,j+1/2,k p= , 
(6.77) 
where A+ and A_ are 
àp = max(0, AR, 18, AR, AR, AB, AE, AD AR TAL VAS), 
à = min(0, AT 18, AR, AR, AB, AT AP AD AR AE, (6.78) 


with the eigenvalues of dF, /du in (6.68) at left and right from the intercell boundary 
at the plane y = yj: 


L L L L L 
A = Uy — CsL, A5 = Uy, A = Uy, AA = UyL, AS = Uy + 6L, 
R R R R R 
Ay = UyR —CsR, Ay = VyR, AZ = VyR, Àj = VyR, A8 = VyR+CsR, 
where 


CsL = A PLY IPL, 


CsR = A DRY / DR- 
(6.79) 


In this case, uy, 41/2,k? uf, j+1/2,k are the values of the variables reconstructed 
at the left L arid right R cells from the interface at y = yj. The Godunov 
reconstructor (5.35) along the y—direction for a variable w, which as described 
above can represent either a primitive or a conservative variable, reads 


L — 
Wi j+1/2,k = Ui, jk. 


UP pik = Wi jtk (6.80) 


or the minmod reconstructor (5.36) along the y—direction 


Wi j+1/2,k — Wijk + oj (Yj+1/2 — yj). 


Wi j41/2,k = Wi, j+l,k + O41 41/2 — Yj+1), (6.81) 


Oj = minmod(m j—1/2, mj+1/2) 
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a ifja| < |b| and ab > 0 
minmod(a, b) = 4 b if |a| > |b| and ab > 0 


0 ifab <0. 
Wi, j+1,k — Wi, j,k 
Mj+1/2 = —————_; 
Yj+l — Yj 
Wi, j,k — Wi, j—1,k 
nj-1/2 = ———.. 
yj — Yj-1 


Notice that w is any variable, either primitive or conservative. Again, our strategy 


here is that we reconstruct the primitive variables p}, vk, vt, D. pt „el, E p. 


p? ; v 2 vk ; uk ; p? , eÈ, and E, and from these, we calculate the conservative 
L _¢,,L uL uL R R 

ones UF iom Uy Ux UZ PP) and uf j+1/2, p u? Uy M3 E E Rj needed in the 

flux formula (6.77). The flux vector F,, according to (6.65) evaluated at ul jane 


R 
LPS reads 


(uy)? 


53-y) p wk — 42 


L,L 
uz Ug 
L 
uy 


(uL (uk? 
4) 


L 
Fy (Uj. i414) = ul $ 


i. ly — Duy + (ub + ub) 2 


uy (uy 2 


(6.82) 


RR 
Uz Uy 


uy 


"i » 


R42 R42 
+ (y — uk - 19219, 
; 
ukuk 


R 
uy 


RR 
ye - 1o DUR? + WB? + DD 


1 
Fy (Ufa) = pee 


(6.83) 


which are the expressions needed in the HLLE flux formula (6.77). 
Fluxes z. Finally, the calculation of (Fiet /2 in Eq. (6.62) uses the following 
HLLE formula for all k = 0,..., Nz — 1: 


L R R L 
(FNLLE | AF; j k41/2) E A-F: (U; j k41/2) HAGA (U; Lois — UKj k42) 
z7i,j,k+1/2 pm — A. , 


(6.84) 
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where A+ and A_ are 


à+ = max (0, AF, A8, AR, AR, AR, AT, ee A5, ew LN 


à = min(0, àR, 18, AR, AR, AB, AF, 15, A5, AF, AE), (6.85) 


with the eigenvalues of dF, /du in (6.69) at left and right from the intercell boundary 
at the plane z = zę: 


d —U—^É€L AL = Uu. AE = UL, Ar = UL, n = VL + CsL, 

AT = UzR — CsR; As = UR, AS = UR, AF = UR, AT = U;R--C6sR. 

where (6.86) 
CsL = A PLY IPL, 

CsR = A PRY /PR. 


Now, ur; k+1/2 uj k+1/2 are the values of the variables reconstructed at the left 
L and right R cells from the interface at z = zz. Godunov reconstructor (5.35) 
along the z— direction for a variable w, which can represent either a primitive or a 
conservative variable, reads 


L Laka 
Wi j,k+1/2 = Wi, j,k» 


WES L1 = Wi, j,k+1> (6.87) 


or the minmod reconstructor (5.36), which along the z—direction reads 


L 
Wi jk+1/2 = Wi, j,k toj (Zk+1/2 — Zk), 


wikt = Wi, j,k+1 + Ok+1(Zk+1/2 — Zk+1), (6.88) 
ok = minmod(mg—1/2, Mk+1/2) 


a ifja| < |b| and ab > 0 


minmod(a, b) = { b if |a| > |b| and ab > 0 
0 ifab <0. 
Wi, jk+1 — Wi, j,k 
Mk41/2 = —_———_ 5 
Zk+1 — £k 
Wi, j,k — Wi, j,k—1 
Bog = —_—____—_. 


Zk — Zk-1 
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Notice that w is any variable, either primitive or conservative. Our strategy here is 
that we reconstruct the primitive variables p}, vL, vk, vt, p}, eL, EL, pk, um. 
es i. p.e R and E^ , and from these, we calculate the conservative variables 

ur, k41/27 -(ui bat ghia ae) and uf EIE =(uj R u3 iia dp ms) needed in the flux 
formula (6.84). The vector of fluxes F,, according to (6.66) at ul rau» PT 


reads 


L 
Fu; i15) = La ul , , 
(ug) 1 uh)? ub 
109 49-0062 ——3 


LL L 
y - a( - DG + U3) + QD ors 


(6.89) 
u3 
ukuk 
uf 
: ukuk 
Fz (u; ; 1,175) = uk ee j 
B-p“ + y - pag - 5D ) 
RR 
yA — iy = DRY + WY + CY) Gap = 
(6.90) 


which are the expressions needed in the HLLE flux formula (6.84). 


Boundary Conditions. Two types of boundary conditions are common in 3D 
hydrodynamics, namely, outflow and periodic boundary conditions. 


Outflow Boundary Conditions. These boundary conditions are provided by 
Eq. (5.39) for 1+1 problems. In 3+1 problems, one generalizes these formulas 
to be implemented on each face of the spatial domain, that is, for every conservative 
variable um, m = 1, 2, 3, 4, 5, one defines trivial Riemann problems on cells at the 
boundary faces: 


uo, j,k = Ul, j,k, UN, j,k = UN,—Lj.k 
U;,0,k = Uil, Uj, NK = Mi N,—1,k 
Ujj0 = U; j1, Ui, j, N, = Ui, j,N;,—1 (6.91) 


with the aim of preventing boundary cells to interfere with the dynamics of the 
interior of the numerical domain. 
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Periodic boundary conditions are implemented following the indications in 
Eq. (6.36). 
Wrapping up the above elements, the method needed to construct the solution of the 
IVP has the following steps: 


1. Set initial conditions for primitive variables of the IVP (6.56). Then use the 
definition (6.59) to initialize conservative variables. 

2. Evolve a time step from time t” to t”+! using the MoL using the semi-discrete 
version of the evolution equations (6.62). This will need the evaluation of sources 
and fluxes as follows: 


(a 


— 


(b 


wm 


(c 


— 


(d) 
(e) 


(f) 
(g) 


Calculate numerical fluxes Fu LLE using the recipe in the sequence 
from (6.70) to (6.76). 

Calculate numerical fluxes rZ LLE using the recipe in the sequence 
from (6.77) to (6.83). 

Calculate numerical fluxes FH LLE using the recipe in the sequence 
from (6.84) to (6.90). 

Calculate the sources S if any. 

Implement the method of lines on the semi-discrete formula (6.62) using the 
Heun-RK2 or RK3 methods. 


Implement boundary conditions on conservative variables. 
Calculate primitive variables for the next step and output 
p = i], 
u2 
vy = —, 
uy 
u3 
Uy — —, 
j wi 
uA 
V=, 
ui 
1 u2 +u +u? 
2 3 4 
pede) E (6.92) 
2 u1 


3. Repeat step 2 until t = ty. 


The method is applied to the following traditional example problems. 


6.5.1 2D Spherical Blast Wave 


Two-dimensional problems can be solved using the 3D code by suppressing one of 
the dimensions by hand into the code as we illustrate here. We define the domain 
to be D = [Xmin, Xmax] X [Ymin: Ymax] X [Zmin: Zmax] X 10, tr] = [-0.5,0.5] x 
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[—0.5, 0.5] x [—0.01, —0.01] x [0, 0.5] that we cover with Ny = Ny = 100 and 
Nz = 2 or equivalently spatial resolution Ax = 0.01 and time resolution given by 
At — 0.125Ax. We use outflow boundary conditions on the cubic surface. 

We use the adiabatic index y = 5/3 and outflow boundary conditions along the 
three directions. Notice that these conditions along the z— direction, being covered 
with two cells only, avoid leaking fluxes through the faces Zmin and Zmax of the 
domain. The initial conditions for the wave are the following: 


(1, 1, 0), if yx? + y? < 0.1 
(po(x), Po(X), Vo(x)) = . (6.93) 
(0.125,0.1,0), if /x2+y2>0.1 


The evolution of these initial conditions triggers an initial explosion with a front 
shock expanding outward. A few snapshots are shown in Fig. 6.11. Notice that the 
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Fig. 6.11 Density p of the numerical solution of the 2D spherical blast wave problem on the 
xy—plane at times t = 0, 0.1, 0.175, and 0.25 


t=0.1 
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use of Cartesian coordinates limits the accuracy in setting initial data in this case and 
the high-density circle is only a lego circle. Afterward, the wave front smoothens 
and becomes more circular. 


6.5.2 3D Spherical Blast Wave 


We now evolve the blast wave in 3D in order to notice the differences with the 
2D problem above. In this case, we define the domain to be D = [Xmin, Xmax] X 
[Ymin» Ymax] X [Zmins Zmax] X [0, ty] = [-0.5, 0.5] x [-0.5, 0.5] x [-0.5, 0.5] x 
[0, 0.5] that we cover with Ny = Ny = N; = 100 or equivalently resolution Ax = 
0.01 with time resolution At = 0.125 Ax. We use outflow boundary conditions on 
the cubic surface. 

We use the same adiabatic index y — 5/3 and the following initial conditions: 


(1, 1, 0), if yx? + y? +z? «041 
(oo(X), po(x), vo(x)) = . (6.94) 
(0.125,0.1,0), if/x2--y2- 22-041 


The evolution of these initial conditions triggers the initial explosion, and a few 
snapshots are shown in Fig. 6.12. Differences between the propagation of a spherical 
shock wave in 3D and a circular one in 2D are the amplitude of density seen in the 
color map and the velocity of the wave front. In the 2D case, the ejected matter fills 
an area, whereas in the 3D it fills a volume. 


6.5.3 2D Kelvin-Helmholtz Instability 


This is an example of how a fluid develops an instability due to a perturbed 
counter flux scenario. We solve this problem on the domain D = [Xmin, Xmax] X 
[Ymins Ymax] X [Zmin: Zmax] X [0, tr] = [=.5, 0.5] x [-0.5, 0.5] x [-0.01, —0.01] x 
[0, 2] that we cover with Ng = Ny = 100 and N; = 2 or equivalently spatial 
resolution Ax = 0.01 and time resolution At = 0.125Ax. 

We use the adiabatic index y — 1.4 and periodic boundary conditions. These 
boundary conditions are important because the instability develops after the fluid 
crosses the domain various times. The initial conditions correspond to a lane of fluid 
moving to the right, above and below which there is a denser counterflow moving 
to the left as follows: 
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Fig. 6.12 Density p of the numerical solution of the 3D spherical blast wave problem on the 
xy—plane at times £ = 0, 0.1, 0.175, and 0.25. These results are to be compare with those in 
Fig. 6.11 


(1, 2.5, (0.5 + 6, 5, 0)), if yx? + y? < 0.1 
(oo(X), po(X), vo(x)) = 
(2, 2.5, (—0.5 + ô, 8, 0)), if yx? + y? > 0.1 
(6.95) 


where the perturbation of the velocity field has the form ô = 0.1 cos(4zr x) sin(4zr y). 
The evolution of these initial conditions triggers the instability, and a few 

snapshots are shown in Fig. 6.13, where the typical curly shapes of this problem 

can be seen. 

The code Euler3p1.f90 serves to solve these exercises and illustrates the 

implementation of the solution of Euler equations according to the theory in this 

section. The code is available as Electronic Supplementary Material. 
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Fig. 6.13 Density p of the numerical solution of the 2D Kelvin-Helmholtz problem on the 
xy—plane at times t = 0, 0.5, 1, and 1.5 


Exercise. Construct a potential o that represents a constant, vertical grav- 
itational field. Code it as a source according to Eq. (6.56) in the appropriate 
arrays sourcel, source2, source3, source 4, and source 
5 of the code above. Then study the effects on the Kelvin-Helmholtz 
instability. 


Exercise. Add gravity to the equations and implement the Rayleigh-Taylor 
instability problem within the code, following the recipe used by the 
ATHENA code [3]. 
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6.6 Diffusion Equation in 2+1 Dimensions 


In the previous section, the example of the 2D blast wave shows how to solve 
problems in 2+1 dimensions using a code designed for hydrodynamics in 341 
domains. The reduction to actual 2+1 domains is straightforwardly obtained from 
3D restricting operators to act only on the xy— plane. All the formulas developed 
in Sect. 6.1 can be used by ignoring dependency of functions on z and the label k 
of discrete operators. We use examples with the diffusion equation to show how to 
implement these ideas. 

There are different degrees of complexity of the diffusion equation, which may 
include spatial dependence of the diffusion coefficient and proliferation terms useful 
in the study of populations. We solve three different scenarios with an increasing 
complexity. First, consider the following IVP: 


au =n (FH + Ee), u = u(x, y, t) 

D = [Xmin, Xmax] X [Ymin, Ymax] X [0, tr] Domain 

u(x, y, 0) =o (x, y) Initial Conditions 
u(8D, t) Boundary Conditions 


(6.96) 


where « is a constant. This is the simplest and typical diffusion equation and is the 
generalization of the case we solved in Sect. 3.4 from one to two spatial dimensions. 
We use the domain D — [0, 1] x [0, 1] x [0, 0.1] and zero Dirichlet boundary 
conditions u(0, y) = u(1, y) = u(x, 0) = u(x, 1) = 0. 

This IVP has exact solution. Using separation of variables u(x,y,f) = 
T (t) X (x)Y (y) leads to the set of three ODEs: 


laT — 1 d?X s 


— i = 6.97 
T dt Xd ^ Ydy m 


with K, a, and b positive constants and the constraint a + b = K /x. Imposing the 
boundary conditions, the solution to these equations is T = Toe Œ", X = 
Asin(nyzx), Y = Bsin(nyz y), with nx, ny integers constrained by the condition 
(n2 + n2)r? = K/k, and A, B arbitrary amplitudes. Setting to = 0 and grouping 
all coefficients into a single one, the exact solution is 
e —k (n2 -n2)z?1 : : 
u^ (x, y,t) = Ce x y sin(nx x) sin(nyz y), (6.98) 
that we use to set initial conditions and monitor the numerical solution. We solve 
the problem numerically using the MoL, on the discrete domain Dg defined with 
Ny, = Ny = 100 or equivalently Ax = 0.01 and At = 0.125Ax?. The semi- 
discrete version of the evolution equation reads 
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au uy; 245; T Pay up jy T 24$ T p jy 
I n * LS (6.99) 


We solve the problem with C = x = 1, n, = 2, and n, = 3. In Fig. 6.14, we 
show two snapshots of the numerical solution, where diffusion can be noticed in the 
amplitude of u. For diagnostics, we also calculate the maximum of u as function of 
time that we compare with the time modulation function T (t) = eg Cy 

A second problem involves a space-dependent diffusion coefficient. This case 
has various applications where the evolution process can be faster or slower in terms 
of the properties of the domain, like in the evolution of brain tumors for example in 
[4] or spread of populations, for example [5]. The IVP is formulated as follows: 
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Fig. 6.14 Snapshots of u at times t = 0, and ¢ = 0.05 for the initial conditions with the exact 
solution (6.98), considering the parameters C = x = 1, n, = 2, and n, = 3. Also shown is the 
maximum Umax Of the solution in the domain as function of time and compared with the exact time 
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au = V. (kVu), u = u(x, y, t), K = k(x, y) 

D = [Xmin, Xmax] X [Ymin: Ymax] X [0, tr] Domain 

u(x, y, 0) = uo(x, y) Initial Conditions 

u(8D, t) Boundary Conditions 
(6.100) 


We again illustrate its solution considering the domain D = [0, 1] x [0, 1] x [0, 0.1] 
and Dirichlet boundary conditions u(0, y) = u(1, y) = u(x, 0) = u(x, 1) = 0. 
Since x = k(x, y) is space-dependent, the equation for u is 

Qu 


3p Vo vu) (6.101) 


Vk -Vu + kV?u 
_ OK LRL: ðu (25 23) 
^ ax dx dy dy 0x? ay? J 


(6.102) 


In order to implement the MoL, we write the semi-discrete version of this equation 
using second-order accurate space derivatives of u and «, for the interior points of 
the discrete domain Dg: 


n n n n 
ðu Ki4i,j — Ki—1,j “i+1,j — “i Lj y jti j 1 Yi j41 T 4i,j-1 


at — 2Ax 2Ax 2Ay 2Ay 
[Uh TG ting) Eja T j tU jy E58 
tki,j Ax2 T Ay? - (6.103) 


As example, we use a diffusion coefficient of the form 


Gc csoanbl as (6.104) 
K(x, y) = ; 1 
» 0.05 


a smooth version of a step function that brings the values x ~ 1 forx < 0.5tok ~ 5 
for x > 0.5 and would show how the diffusion coefficient affects the evolution at 
each half domain. 

For the numerical solution, we use the discrete domain Dg defined with Ny = 
Ny = 100 or equivalently Ax = 0.01 and At = 0.125Ax?. As initial conditions, 


we use the Gaussian function uo(x, y) = e—l(x—0.5°+(y—-0.5)"1/0.05_ The results at 
various times are shown in Fig. 6.15, which illustrate how the right side of the 
domain diffuses the signal more rapidly than the left half. 

The third problem is a generalization of the predator-prey problem of 
Sect. 2.11.1, which models the interaction of two species but this time with the 
intervention of the space through diffusion. This is a two-species ecological system 
whose implementation follows the recipe in [6]. This model assumes there are two 
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Fig. 6.15 Snapshots of u at times t. = 0,0.05,and0.1 for the initial condition uo(x, y) = 
e-la—0.5)"+(y-0.5)°1/0.05_ The right half of the domain has a five times bigger diffusion coefficient 
than at the left, and consequently the initial data are diffused more rapidly 


species described by populations u; and u2, whose evolution is governed by the 
following IVP: 


"n —uj(1—uj) — vu +da,;V2u, 
He — ju» (1 = ga) + do V?u» uj — uic, y, t), u2 = u2(x, y, t) 


D = [Xmin; Xmax] X [Ymin: Ymax] X [0, tf] Domain 
u(x, y, 0) = 41,0, y), 

u2(x, y, 0) = u2,0(x, y) Initial Conditions 
u1(89D, t), u2(dD, t) Boundary Conditions 


(6.105) 
Notice that population u; grows according to the logistic model and interacts 
with u2 through the crossed nonlinear term in the first equation. This species 
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diffuses in space with coefficient dı. Population u2 interacts with species u; through 
coefficients ô and £ and diffuses spatially with coefficient d». 
As shown in [6], this system of equations has an equilibrium point at 


(6.106) 


that helps to design a couple of evolution scenarios. We solve the system using 
the MoL, with second-order accurate semi-discrete version of the equations in the 
domain D = [0, 200] x [0, 200] x [0, 2000]. The discrete domain Dg uses Ny, = 
Ny = 200 or equivalently Ax = Ay = 1 and At = 0.01 Ax?. 

Initial conditions are chosen near the equilibrium values u1 0 = u} + noise and 
u20 = u3, where noise = 0.001 x random, where random is a random number 
with values in the range [0, 1]. We present two examples with parameters a = 0.4, 
B = 5/4, dı = 1, and d» = 7 and two values ô = 0.6 and 0.535. 

Boundary conditions are periodic, so that the populations interact, diffuse, and 
reenter the domain. 

The results of the evolution in the two cases are shown in Fig. 6.16, where the 
most important feature is the formation of patterns that depend on the value of ô. 


t-1500 t-3000 
200 


0.1902 
0.1901 
08 

0.1899 
0.1898 


0.1897 


100 100 


0.1896 
0.1895 
0.1894 
0.1893 
0.1892 


0.1891 


0.1902 


0.1901 


019 


0.1899 


0.1898 


0.1897 


100 100 


0.1898 


0.1895 


0.1894 


0.1893 


0.1892 


0.1891 0.05 


Fig. 6.16 Population uw; at various times for parameter 6 = 0.6 at the top and ô = 0.535 at the 
bottom. At initial time, the population has equilibrium value uj} and perturbed with random noise. 
Eventually, patterns are formed with time that illustrates how population u; accommodates. In the 
two cases, for comparison, we use the same initial conditions, including the same random noise, 
so that the pattern distribution of the population is only due to ô 
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The code Diffusion2p1.f90 solves the first and second problems and is 
listed in Appendix B. The code PredatorPreyDiff2p1.f90 which solves the 
third problem is available as Electronic Supplementary Material. 


6.7 Projects 


With the methods described in this chapter, it is possible to carry out the following 
projects: 


6.7.1 Stationary Solar Wind and CMEs 


The results from Sect. 5.3 related to the formation of the solar wind, and the 
evolution of a spherical ejection can be generalized and brought to more realistic 
scenarios still within the hydrodynamical regime without considering the magnetic 
field carried by the wind, this time by only breaking the spherical symmetry. The 
equations modeling this scenario are those in the IVP (6.56). 

In the spherically symmetric example of Sect. 5.3, where the Sun is assumed to 
be at the origin, the numerical domain is chosen [Fmin, Fmax], With rmin finite. In 
the 3D domain described with Cartesian coordinates, the implementation of such 
strategy is not as simple, because the sphere of radius rj, to be excised is in the 
best case a lego-sphere, and the implementation of injection boundary conditions as 
done in Sect. 5.3 is not straightforward. What we do is that we evolve the variables 
in the whole cubic domain, except within the sphere of radius rj,;5, where all the 
variables, primitive and conservative, are kept fixed with the values of the solar wind 
variables. This strategy will produce the equivalent results to those obtained with the 
spherically symmetric code. 

The formation of the stationary SW can be simulated with conditions similar to 
those of the 3D blast wave of Sect. 6.5.2 but, this time, maintaining the values of the 
variables constant within the sphere of radius r = rmin. The initial conditions are 
given for density, velocity, and temperature as follows: 


Pwind, ifr X Fmin 
po(x) = 

0.01 pwina, ifr > lmin 

(XUwind/T, YUVwind / '» ZUwind/ Y), iff  Fmin 
vo(x) — 


0, ifr > fmin 


To(X) = Tyind (6.107) 
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where r = yx? + y? + z? is the radial coordinate and Pyind, Vwind, and Twina are 
the number density, radial velocity and temperature of the solar wind, respectively. 
The pressure is obtained from the temperature po(x) = jpo(X)To(X), whereas the 
internal energy from the ideal gas EoS e(x) = po(x)/po(x)/(y —1) and therefore the 
total energy density E — pv? + e). These variables serve to start a simulation of 
a solar wind formation using the code in Sect. 6.5, with the condition that variables 
remain as initially within the sphere of radius min = 17.18Ro. Then eventually 
the wind will settle as shown in Fig. 6.17 for a solar wind with number density 
po = 2100, radial velocity vying = 2.5 x 10? m/s, and temperature 5 x 10° K, the 
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Fig. 6.17 Snapshots of density, radial velocity, and temperature along the x—axis for a solar wind 
pumped with properties Pwina = 2100, radial velocity vyj44 = 2.5 x 10? m/s, and temperature 
5 x 10? K. Notice that within the sphere of radius rin, the variables remain time-independent. 
These results can be compared with those obtained from the spherically symmetric simulation of 
Sect. 5.3, where excision was implemented inside r = rj. In these coordinates, Earth is located 
on the x —axis at 214.83452 Ro 
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same parameters used in Sect. 5.3 and of the same type as those prescribed for solar 
winds (see, for example, [7, 8]). 

The use of a 3D code with no symmetries allows the simulation of events with no 
symmetries. This is the case of a coronal mass ejections (CME) that are responsible 
of magnetic storms all across the Solar System. Like the stationary solar wind, 
CME can be launched from the domain inside the sphere of radius rin, with its 
own density, velocity, and temperature, along a particular direction with a particular 
opening angle. A simple way to implement this ejections is to define the direction, 
for example, $o,c M E and 0o, c E with opening angles ó$cyg, SOcME. 

The injection of a CME is implemented by raising the density, velocity, and 
temperature from Pwind, Vwind and Twind to PCME, VCME, and Tc g values within 
the opening angle for r < rmin during a time window. We show an example with 
a gas ten times denser pc yg = 21000, faster vcyg = 6.5 x 10? km/s, and hotter 
TcME = 1 x 106 K, the same conditions as in [8], injected during a time window of 
3h for the orientation $9, c E = lrad, 0o,cmeE = 0, and ó$c ug = ô0cme = 0.5 
rad, on the equatorial plane. Three snapshots appear in Fig. 6.18, where we show 


snapshots of density prior, during, and after the CME is ejected. 
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Fig. 6.18 Snapshots of density during the evolution of the CME at times prior to injection, during 
injection, and after injection of the CME variables. Notice the high density within a cone-shaped 
region within rj; during injection and the front shock of the CME in the third snapshot 
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The project consists in the generalization of the code that solves the 3D Euler 
equations in Sect. 6.5 and make it capable of simulating the formation of a stationary 
solar wind and the propagation of a CME. 

The project can be brought to the next level and include detectors in the sense of 
Fig. 5.14, using a generalization of the code in Sect. 5.3. Real position of various 
satellites like Stereo A, Stereo B, Solar Orbiter, and Parker Solar Probe can be 
incorporated into the domain and measure the properties of the plasma of their 
positions. Needless to say that a detector at Earth's location would be very useful, 
because it would allow to know the properties of the plasma when it arrives to Earth. 

Further details, for example, the conversion from physical to code units, the 
addition of the gravitational potential of the Sun in the source of Euler equations, as 
well as astronomical details like the coordinates used, can be found in [9]. 


6.7.2 Relativistic Hydrodynamics in 3+1 Dimensions 


In Sect. 5.4, we developed the evolution equations of a relativistic inviscid fluid. 
Here, we rewrite Eq. (5.56): 


dD 0 ; 

— + —(Dy') = 

ar ant a y=), 

as! à 55 

—(S'v/ dij) = 0, (6.108) 

m To v! + póij) 

OT 0 ; 

— -(S' — Dv’) = 

» y uL 


Likewise in the Newtonian case, these equations can be written, following (5.57), 
as a set of flux balance laws like (6.60): 


Fj OF, F 
LL RICE NT B. 


S, (6.109) 
ot ax dy Oz 


which are solved following the same sequence of steps needed for the Newtonian 
equations as described in Sect.6.5. The main difference, a very important one, 
is the recovery of primitive variables, which depend on the construction of the 
pressure. This can be done using a generalization found for the relativistic equations 
in Sect.5.4 with Eq. (5.64). The transcendental equation for the pressure needs 
to be slightly generalized using, instead of only S**, the summation of the three 
components of Si, that is, S*? + S}? + S* in (5.64). Also, the Lorentz factor W 
should include instead of only (v*)? the squared velocity (v*)? + (v)? + (v2)? 
within the square root of Eq. (5.63). 
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Fig. 6.19 At the left, a slice of the density during the formation of a relativistic Kelvin-Helmholtz 
instability solved with 3+1 relativistic hydrodynamics. At the right, a slice of the wind tunnel test 
for a relativistic hydrodynamical flow. The initial parameters and setup can be seen in [10] 


As a sample problem, we show in Fig. 6.19 a late-time snapshot of the density of 
a Kelvin-Helmholtz instability, as well as the Emery wind tunnel, which are standard 
tests of a hydrodynamic code. 

The initial conditions for these problems, other tests, and details of how to 
implement a code that solves the 3+1 relativistic Euler equations can be found in 
[10]. The project can consist in the reproduction of all the tests in such paper, which 
can lead to interesting problems like the evolution of astrophysical jets. 


6.7.3 Magnetohydrodynamics 


The relativistic equations from the previous project can be generalized to model 
the dynamics of relativistic plasmas with the magnetohydrodynamics (MHD) 
equations. The details of physics, numerical methods, tests, and subtleties of the 
implementation can be found also in [10]. 

A different generalization of relativistic Euler equations couples the gas dynam- 
ics to radiation, in which both fluid and radiation pressures interplay in the 
fluid dynamics. The solution of these equations has applications in high-energy 
astrophysics. Details of an implementation of a code that solves the relativistic 
radiation hydrodynamics is [11]. 

In the Newtonian regime, the equations from Sect. 6.5 and Project 6.7.1 can also 
be generalized to the MHD equations. The details of a simple implementation using 
the methods described in this book can be found in [12]. There are different degrees 
of complexity, for example, the inclusion of resistivity and thermal conduction [13]. 
Applications of these equations are easy to implement, for example, in [14], it 
is possible to find a model that describes the magnetic reconnection process as 
a mechanism to trigger small jets on the solar surface in two dimensions and its 
straightforward generalization to three dimensions [15]. 

Disciplined but small variants of the codes here will help to reproduce the results 
in the aforementioned papers. 


310 6 Initial Value Problems in 341 and 2+1 Dimensions 
6.8 How to Improve the Methods in This Chapter 


In 3+1 problems, the use of memory becomes important. The problems solved use 
a discrete domain with 100? cells, or equivalently, one has to store a number of 
order 10° or 107 double precision numbers. In 1+1 problems, it is possible to cover 
a similar spatial domain with a resolution of order Ax/10^. This indicates that 
accuracy is sacrificed when solving 3+1 problems. 

One solution to this problem is parallelization, for which it is straightforward to 
use the MPI libraries to allow the solution of 3+1 problems in shared and distributed 
memory computers. This can help using higher resolution and therefore better 
accuracy. 

A second common solution is the use of mesh refinement. With this method, 
resolution, therefore, memory is spent in the regions where resolution is needed. 
The original version of adaptive mesh refinement (AMR) was defined in [16] 
for hyperbolic systems of equations, with specifications to make it work for 
hydrodynamics [17]. However, it is recommended to program using data structures, 
instead of arrays of numbers. 

A much simpler but inflexible alternative is fixed mesh refinement (FMR), where 
refined subdomains are boxes, not arbitrarily distributed refined cells like AMR. A 
description of this method can be found in [18] and an application for Schródinger 
equation in [19]. 

In the particular case of /tydrodynamics, multidimensional problems beyond the 
1+1 case offer a variety of implementations. Here, we have used a semi-discrete 
version of Euler equations that integrates in time the contribution of the fluxes along 
all directions. Other methods include flux splitting along each direction, similar 
to the ADI one-direction-at-a-time method used in the implicit Crank-Nicolson 
scheme, and also Strang splitting with fractional time steps. These methods are 
clearly exposed in [20]. 

Finally, we use Euler equations of hydrodynamics as the workhorse, because 
they are rather difficult to solve due to the formation of discontinuities. Navier- 
Stokes equations conform a more general set of fluid dynamics equations because 
of the inclusion of viscosity, and surprisingly may not need the use of finite 
volume methods, because viscosity tends to smoothen functions out and prevents the 
formation of shocks. Instead, the use of the finite difference discretization, simpler in 
concept and implementation, the same used for the wave and Schródinger equations, 
may work for Navier-Stokes equations straightforwardly. 
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Chapter 7 A 
Appendix A: Stability of Evolution TCA 
Schemes 


We follow the description of stability proofs in the book by J. W. Thomas [1]. 

Let u” the solution of an evolution scheme at point (x;, t”) of the numerical 
domain in 1+1 dimensions. Assuming u” € £2, A,, the space of functions with finite 
Riemann sum calculated with resolution Ax, then the discrete Fourier transform 
(DFT) of u is the function û € L2[—z, zt] 


^ 1 —im 
a6) = Te XO eium (7.1) 


with £ € [—z, x]. The inverse Fourier transform of i is 


1 m 
v 2m J-z 


Parseval's relation establishes that 


ei"5$ (&)dE. (7.2) 


ug — 


A ||ul|2,a 
llåll2 = [ulla = ———. (7.3) 
Ax 


The scheme is stable if there are K and f such that the solution at time r”+! is 
bounded: 


[u^ *! |o A, < KePe*DAr tw? qu, (7.4) 


and in practice what is done to prove stability is to use Parseval's relation and prove 
that K and £ exist for the norm of the DFT: 


Jarl fn < Kef ®+D4 Plh Ax. (1.5) 
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Then, if (7.5) holds, it is said that the sequence of functions {i”} is stable in the 
space L2. In summary, the sequence u” is stable in £2, 4x if and only if {i} is stable 


in L;([—7. 7 ]) [1]. 
Diffusion Equation. We study the stability of two evolution schemes for the 
equation in problem (3.49): 


Ut = Kyy. (7.6) 


The Forward in time centered in space (FTCS) scheme used in Sect. 3.4 is defined 
with forward first-order time derivative and centered space derivative around the 
point (xy, t”): 


yor! n n _ n n 
Uk — Uuk p k=l Quy + up E 
At Ax? 
+1 
u, = aug, + (0 — 2ar)ug ou, (7.7) 


where œ = KA . The DFT of this scheme reads 


gg 


CO 
« —ik n 1— 2g —iké n 
=e eu tS ye] 
2T 156 2T ia oo 
—— y eu, (7.8) 


shifting labels, m = k + 1 in the first summation and m = k — | in the third one, we 
obtain 
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= [2a cos é + (1 — 2a)] ù” 


_ si 5 a, (7.9) 


where the factor in brackets is called the symbol p(&) of the scheme (7.7). Now, the 
evolution from time 1? to 1" *! is given by the successive application of the symbol 


n+l 
antl [ HT. 3 à. (7.10) 


and the stability is guaranteed if o is restricted such that 


2 


|| desi a <1, (7.11) 


because (7.4) is fulfilled with K = 1 and £ = 0. Expanded, this condition reads 


-1<1-4asin? $ < 1. (7.12) 
The first inequality reduces to 4o sin? : < 2 which implies 
M n (7.13) 
BS AS T l 


The second inequality is true for any positive a. Therefore, (7.13) is a sufficient 
condition for the scheme (7.7) to be stable. 


We now analyze the stability of the Crank-Nicolson scheme used in Sect. 3.4.2, 
constructed from the discretization (3.54) around the virtual point (xy, perum. 


B Ax? Ax? 


ut -ua d [uti ugt tuti wpi-2wptupu 
Pr 5K (7.14) 
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(7.15) 
where œ = KA . The DFT of this scheme reads 


e l jen Lt, FEM 
- gae antt 2 a Lege = xe eË guia = gue iby n a (- o)ü" p= "d een n 
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from which the symbol can be isolated: 


je c PER. 
i = p(eya" = zae i L(1—o)4 ae’! 


—lae-i6 + (1 +a) — lgeit a 1 + 2a sin? 
2 2 


sn 1 — 2a sin? 


The evolution from time f° to t”+! is given by the successive application of the 


symbol on the initial conditions: 


qu - per? (7.18) 


and the stability condition (7.4) is satisfied if o is restricted such that the sufficient 
condition |o(&)| < 1 is satisfied. The symbol is more complicated than that for 
the FTCS scheme, and the inequalities are not as straightforward. However, looking 
for conditions on o where p(&) has maximums or minimums suffices. Equating the 
derivative of (7.17) to zero, one finds that € = 0, +x are critical points of o. At 
these points, we have that 


p(0) — 1, 
] — 2a 
poe 14 2a° 
This indicates that € = 0 satisfies the sufficient condition, whereas for § = +72 we 
have 
VT ] — 2a <] 
~ 1+4+2a ` 


and the two inequalities are satisfied with no restriction on o. It is then said that the 
scheme is unconditionally stable. 

Stability of the centered in space centered in time (CSCT) scheme, used for the 
wave equation (3.27) in Sect. 3.2. The scheme at point (xz, t”) of the numerical 
domain is written as 


ugt! =a [uta — 2u% + ut i] T2u,-— ur. (7.19) 
with o = (At/Ax)?. The DFT of this formula is 
a) 2 wef” +20 — o)ü ae 8a" — à", 


= E — 2a sin? J fag. 


7 Appendix A: Stability of Evolution Schemes 317 


where now the transform at time t”~! appears, something not seen in the previous 
examples. As done before, we propose that #”+t! = p(&)a#” and then à" = 
p (E)á"—!, which substituted in the expression above gives 


pi" = [2 — 2a sin 5l tag) = 


|? p (2 2o sin? i) + ] w'=0, => 


if B :— 2 — 2a sin? 2 then 


p=B+,/p2-1. (7.20) 


Ifa > 1, then 6 can be < —1. On the other hand, if |o| < 1, then |B| < 1, which in 
turn implies that the modulus of the symbol o = 1, which is a sufficient condition 
for the scheme to be stable. Then, in summary, œ = (At/Ax)? < 1 is a sufficient 
condition for the scheme (7.19) to be stable; since both At and Ax are positive, the 
condition reduces to At/Ax < 1. 


Chapter 8 A 
Appendix B: Codes TCA 


The codes that reproduce the results in this book are available as Electronic 
Supplementary Material (ESM). In the first section of this appendix, we describe the 
list of codes in the ESM used to reproduce the results of each chapter, written both 
in Fortran 90 and C++. Also, from each chapter of the text, the Fortran 90 version 
of one or two codes has been selected to appear complete because they are relevant 
to bring the ideas in the text into practice right away. These codes are included in 
the second section. 


8.1 Summary of Codes 


A few codes selected from each chapter are printed in this appendix because they 
are relevant to bring the ideas in the text into practice right away. The list of codes 
used in each chapter are next summarized. 

Chapter 2 

The codes that solve Newton Cooling Law using Euler, Backward Euler, and 
Average Euler are listed within the text and should reproduce all the results in 
Sects. 2.3, 2.4, and 2.5. The results in Sect. 2.6 for the harmonic oscillator can be 
reproduced with the codes in the text as well. 


The codes used to reproduce the results of the various applications are all available 
online as ESM: 

[ rk4_HO.f90 / rk4 HO.cpp | for the results in Sect. 2.9 and illustrates the 
implementation of the RK4 method. 


Supplementary Information The online version contains supplementary material available at 
(https://doi.org/10.1007/978-3-031-35187-7 2). 
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[rk4 PP.f90 / rk4 PP.cpp ]forthe predator-prey model in Sect. 2.11.1. 

[rk4 SIR.f90 / rk4 SIR.cpp ]forthe SIR model of disease dynamics in 
Sect. 2.11.2. 

[ rk4 Lorenz.f90 / rk4 Lorenz.cpp | for the Lorenz system in 
Sect. 2.11.3. 

[ rk4 Pendulum.f90 / rk4 Pendulum.cpp ] for the pendulum in 
Sects. 2.11.4 and 2.11.5. 

[ rk4 PendulumBasin.f90 / rk4 PendulumBasin.cpp  ] used 
for the construction of the basin of attraction of the damped pendulum in 
Sect. 2.11.5. 

[rk4 NewTOV.f90 / rk4 NewTOV.cpp ]serves to construct the equilib- 
rium TOV stars in Sect. 2.11.6. 

[rk4 RelTOV.f90 / rk4 RelTOV.cpp ] solves the construction of rela- 
tivistic TOV stars in Sect. 2.11.7. 

[ rk4 Helmholtz.f90 / rk4 Helmholtz.cpp  ] uses the shooting 
method to solve Helmholtz equation in Sect. 2.11.8. 

[rk4 SunPlanets.f90 / rk4 SunPlanets.cpp ] solves the problem 
of test particles on a central field and is adapted to track the trajectory of planets 
in Sect. 2.11.9. 

[ rka TwoBodies.f90 / rk4 TwoBodies.cpp ] solves the two-body 
problem from Sect. 2.11.10. 

We include in this appendix the code [ rk4_SIR.£90 ] as an example of the 
implementation of the solver, with a variety of initial conditions. The idea is that 
the implementation can be seen right away. 

Also included is the code[ xrk4 SunPlanets.f90 ], because it illustrates the 
implementation of the alternative version of the solver, without the need of 
arrays. 


Chapter 3 


[WaveSimple.f90 / WaveSimple.cpp ] solves the 1+1 wave equation 
using the simple discretization described in Sect. 3.2. This code appears online 
as ESM and can be reconstructed from the text. 

[WaveImplicit.f90 / Wavelmplicit.cpp ]solvesthe 1+1 wave equa- 
tion using the implicit Crank-Nicolson method from Sect. 3.3. 

[DiffSimple.f90 / DiffSimple.cpp |] solves the 1+1 Diffusion equa- 
tion with the forward in time centered in space discretization in Sect. 3.4.1. 

[Difflmplicit.f90 / DiffImplicit.cpp ] solves the 1+1 diffusion 
equation from Sect. 3.4.2 using the implicit Crank-Nicolson method. 

[ SchroedingerImplicit.f90 / SchroedingerImplicit.cpp |] 
solves the 1+1 Schródinger equation for the particle in a box and in a harmonic 
trap potential from Sect. 3.5. 

The code [ SchroedingerImplicit.f90 ] is included below in this 
appendix because it contains the solver of the linear system with a tridiagonal 
matrix and also uses arrays of complex numbers. 
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Chapter 4 


[MoLAdvection.f90 / MoLAdvection.cpp ]solves the 1+1 advection 
equation and illustrates the functioning of the method of lines in Sect. 4.3. 

[MoLWave.f90 / MoLWave.cpp ]solves the 1+1 wave equation using the 
MoL in Sect. 4.4. 

[MoLWaveGauge.f90 / MoLWaveGauge.cpp ]solvesthe 1+1 wave equa- 
tion on a general Minkowski space-time using the MoL in Sect. 4.5. 

[ MoLSchroedinger.f90 MoLSchroedinger.cpp  ] solves the 1+1 
Schródinger equation using the MoL in Sect. 4.6. 

[MoLEFWave.f90 MoLEFWave.cpp ] solves the wave equation on top of a 
Schwarzschild black hole in Sect. 4.7. 

[ EarthCrust.f90 / EarthCrust.cpp |] solves the reaction-diffusion 
equation for the evolution of the Earth's Crust temperature in Sect. 4.8. 

From this chapter, we include the code [MoLWave.£90 ] in this appendix. The 
reason is that it illustrates the implementation of the MoL for a system of 
three equations, more complex than the scalar advection equation, and also less 
elaborate than the wave equation on nontrivial space-times. 


Chapter 5 


[MoLBurgers.f90 / MoLBurgers.cpp | solves Burgers equation using 
the MoL and illustrates the formation of a discontinuity in Sect. 5.1. 

[MoLEuler.f90 / MoLEuler.cpp |] solves the 1+1 Euler equations for an 
ideal gas in Sect. 5.2. 

[ SolarWind.f90 / SolarWind.cpp ] simulates the formation of the 
stationary solar wind and the propagation of a spherical blast wave on top of 
it in Sect. 5.3. 

[RelativisticEuler.f90 / RelativisticEuler.cpp ] solves the 
1+1 relativistic Euler equations in Sect. 5.4. 

[ BlackHoleAccretion.f90 / BlackHoleAccretion.cpp ] simu- 
lates the evolution of accretion toward Michel solution in Sect. 5.5. 

In this appendix, we include the code [ MoLEuler.f90 ], which is illustrative 
because the steps from the text concerning the finite volume method can easily 
be identified. 


Chapter 6 


[WaveSimple3pi.f90 / WaveSimple3p1.cpp ] solves the 3+1 wave 
equation using the simple discretization in Sect. 6.2. 

[  WaveSimple3pl1Source.f90 / WaveSimple3p1Source.cpp ] 
solves the 3+1 wave equation with a source also in Sect. 6.2. 

[ MoLWave3p1.£90 / MoLWave3pl.cpp ] solves the 3+1 wave equation 
using the MoL in Sect. 6.3. 

[ Schroedinger3p1.f90 / Schroedinger3pl.cpp ] solves the 3+1 
Schródinger equation using the implicit Crank-Nicolson method and the ADI 
scheme in Sect. 6.4. 
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[ Euler3p1.£90 / Euler3pl.cpp ] solves the 3+1 Euler equations in 
Sect. 6.5. 

[Diffusion2p1.f90 / Diffusion2pl.cpp ] solves the 2+1 diffusion 
equation with constant and variable diffusion coefficient in Sect. 6.6. 

[ PredatorPreyDiff2p1.f90 / PredatorPreyDiff2pl.cpp ] 
solves the two species model with diffusion in Sect. 6.6. 

From this chapter, we show the code [ Schroedinger3p1.f90 ], which 
illustrates the splitting of spatial operators, and the calculation of integrals 
of density and expectation values in three dimensions. Also included is [ 
Diffusion2p1.f90 ] that contains the implementation of a 2+1 evolution 
code using the method of lines. 


8.2 Selected Codes 


Complete Code of Selected Programs by Chapter. 
Chapter 2 


Code [ rk4 SIR.f90 ] forthe SIR model of disease dynamics in Sect. 2.11.2: 


! Author: Francisco S. Guzman 

! Last modified: 17/January/2023 

! Purpose: Solves the IVP for the SIR model 

! Parameters to experiment with: sigma, gamma, mu 
! Output file: SIR.dat 

1 Output: t S X R 


module numbers 


! Arrays 

real(kind-8), allocatable, dimension (:) : t 

real(kind-8), allocatable, dimension (:,:) :: u 

real(kind-8), allocatable, dimension (:) :: kl,k2,k3,k4,rhs 
! Parameters 


real(kind-8) s0,i0,r0,mu,beta,gamma,sigma 


! Numerical Domain and Number of Equations 
real(kind-8) t0,tmax,dt 
integer N,resolution label,NE 
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end module 


program rk4 SIR 
use numbers 
implicit none 


! Counters defined locally 
integer i,j,k 


! Define some parameter values 


resolution label - 1 

NE 23 

N - 50000 

to = 0.0 

tmax = 1000.0 

N = 2x» (resolution _label-1)+*N 
s0 - 0.1d0 

io - 0.9d0 

roO - 0.0d0 

sigma - 3.0d0 ! Case A = 0.5 -- 
gamma - 1.0d0/3.0d0 

mu = 1.0d0/60.0d0 

beta = sigma « ( mu + gamma ) 


I 
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Number of cells for the discretized domain 


! Allocate memory for the various arrays 


EEG time 
Io" C) S 
E u(2,:): i 
! u(3,:): Ë 


allocate (t (0:N),u(1:NE, 0:N) ,rhs (1:NE) ,k1(1:NE) ,k2(1:NE) ,k3 (1:NE) , k4 (1:NE) ) 


PART A EO S 


(tmax - t0) / dble(N) 
do i=0,N 
t(i) = tO + dt « dble (i) 
end do 


PART B 
! Set initial conditions 
open(1,file-'SIR.dat') 


do k=0,8 
u(1,0) = sO + dble(k) x 0.1d0 
u(2,0) = 1.0d0 - u(1,0) 
u(3,0) = ro 
print «, 'Scenario,,s0-',u(1,0),'i0 
do i-1,N 
do j-1,4 
if (j.eq.1) then 
call calcrhs( t(i-1) ,u(: 
ki = rhs 
else if (j.eq.2) then 
call calcrhs( t(i-1) 


k2 - rhs 


+ 0.5d0 « dt, 


-',u(2,0) 


,i-1)) 


u(:,i-1) + 0.5d0 x k1(:) 


x dt) 
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else if (j.eq.3) then 
call calcrhs( t(i-1) + 0.5d0 « dt, u(:,i-1) + 0.5d0 « k2 « dt) 


k3 - rhs 
else 
call calcrhs( t(i-1) + dt, u(:,i-1) + k3 « dt) 
k4 - rhs 
u(:,i) = u(:,i-1)+(1.0d0/6.0d0)*(k1 + 2.0d0 * k2 + 2.0d0 « k3 + k4 )«dt 
end if 
end do 
end do 
[ cue > Save data geese 


do i=0,N,2** (resolution _label-1) 
write(1,«) t(i),u(i,i),u(2,i),u(3,i) 

end do 

write(1,»») 

write(l,x) 


end do ! ends the solutions with different initial conditions 
close(1) 


print +, 'Program, finished' 


end program 


subroutine calcrhs (my t,my u) 


use numbers 
implicit none 


real(kind-8), intent(in) :: my t 

real(kind-8), dimension(NE), intent(in) :: my u 

rhs(1) = mu - mu » my u(1) - beta * my u(1) * my u(2) 

rhs(2) = -mu « my u(2) - gamma « my u(2) + beta « my u(1) « my u(2) 
rhs(3) = gamma « my u(2) - mu x my u(3) 


end subroutine calcrhs 


Command on gnuplot that reproduce the phase-space diagrams for the SIR system in 
Figs. 2.18 and 2.19: 


gnuplot piot "fuese" wr Aes vy di 
Time series of S, I, R use 


gnuplot- Tode ASTR Adat qu abe) vy JU U^ wy aes wy I, 4 wl edt ty dL 
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Code [ rk4 SunPlanets.f90 ] solvesthe problem of test particles on a central field 
and is adapted to the planets trajectory in Sect. 2.11.9: 


Author: Francisco S. Guzman 
Last modified: 17/January/2023 
Purpose: Solves the IVP for the Planets around the Sun 
Parameters to experiment with: add new planets with their own orbital parameters 
Output file: SunPlanets.dat 
Output: È x y z 
wehere x,y,z are the Cartesian coordinates of planet's position 


module numbers 


! Arrays 
real(kind-8), allocatable, dimension (:) :: u,u p 
real(kind-8), allocatable, dimension (:) k1,k2,k3,k4,rhs 


! 


Parameters 


real(kind=8) x0,y0,z0,vx0,vy0,vz0,MSun,G,a,e,r0,dotphi0, radian, Theta, Omega 


! 


Numerical Domain and Number of Equations 


real (kind=8) t0,tmax,dt,t 
integer N,resolution_label,NE 


end module 


program rk4 CentralField 


us 


e numbers 


implicit none 


! 


Counters defined locally 


integer i,j 


! 


G= 


mm Constants €«--- 
6.6743e-11 ! (m^3 / kg / s^2) 


MSun = 1.98847e30 ! (kg) 


rai 


! 
! 


y 
fe 
la 


> 
M 
+ 
w 
L 


dian = 57.2957795130823 ! Degrees 


Parameters for different objects in different blocks 
Uncomment the object you want to consider 


Earth :: with phi - 0 at initial time 


- 0.0167086 
= 1.49598023e11 
0.0 ! with respect to the ecliptic 


lOmega = -11.26064 
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! Jupiter 

le = 0.0489 

la = 7.78479e11 

!Theta = 1.303/radian ! with respect to the ecliptic 
!Omega = 100.464/radian 


! Pluto 

e = 0.2488 

a = 5.906423e12 

Theta = 17.16/radian ! with respect to the ecliptic 
110.299/radian 


Omega 


! Halley 

le = 0.96714 

la = 2.66792e12 

!Theta 162.26/radian ! with respect to the ecliptic 
!Omega = 58.42/radian 


rO =a» (1.0d0 - e««2) / (1.0d0 +e ) 
dotphiO = (1.0d0 + e)**2 « sqrt( G « Msun / ax«3 / (1.0d0 - e««2)»x«3 ) 


1 Define some numerical parameter 


resolution label - 1 

NE 26 

N = 100000000 !100000000 Pluto and Halley, smaller for other cases 

to = 0.0 

tmax = 10000000000. ! (sec) 10000000000. Pluto and Halley, smaller for other cases 
N = 2*««(resolution label-1) » N ! Number of cells for the discretized domain 
x0 = cos(Omega) « r0 * cos(Theta) 

yo = sin(Omega) * r0 * cos(Theta) 

zo = r0*sin(Theta) 

vx0 = -gin(Omega) * r0 » dotphiO 

vy0 = cos(Omega) * r0 » dotphiO 

vzo = 0.0d0 


! Allocate memory for the various arrays 


! u(1): x 
! u(2): y 
! u(3): Zz 
! u(4): vx 
I u(5): vy 
! u(6): vz 


allocate(u(1:NE),u p(1:NE),rhs(1:NE),k1(1:NE),k2(1:NE) , k3 (1:NE) , k4 (1:NE)) 


jodscee > PARTA  «----- 
dt = (tmax - t0) / dble(N) 
print «, 'dt-',dt 


PS cou > PART B  «----- 
1 Set initial conditions 
open(1,file-'SunPlanets.dat') 


u(1) = x0 

u(2) = yo 

u(3) = z0 

u(4) = vxO 

u(5) = vy0 

u(6) = vzO 

t = 0.0d0 

write(1,*) t,u(1),u(2),u(3) 

! Evolve 
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up-u 
do j-1,4 
if (j.eq.1) then 
call calcrhs( t ,u p(:)) 
k1 = rhs 


else if (j.eq.2) then 
call calcrhs( t + 0.5d0 « dt, u p(:) + 0.5dO » k1(:) æ dt) 
k2 - rhs 

else if (j.eq.3) then 
call calcrhs( t + 0.5d0 * dt, u p(:) + 0.5d0 * k2 * dt) 


k3 - rhs 
else 
call calcrhs( t + dt, u p(:) + k3 * dt) 
k4 - rhs 
u(:) = u_p(:) + (1.0d0/6.0d0)*( k1 + 2.0d0 * k2 + 2.0d0 * k3 + k4 ) * dt 
end if 
end do 
! Saving data to a file every 10000 iterations 
tz tdt 


if (mod(i,2*««(resolution label-1)*10000).eq.0) then 
write(1,«) t,u(1),u(2),u(3) 
print *, "iteration",i,"time-",t 

end if 


end do 


close(1) 
print +, 'Program, finished' 


end program 


subroutine calcrhs (my t,my u) 


use numbers 
implicit none 


real(kind-8), intent(in) :: my t 

real(kind-8), dimension(NE), intent(in) :: my u 

rhs(1) = my u(4) 

rhs(2) - my u(5) 

rhs(3) - my u(6) 

rhs(4) = -MSun«G«my u(1)/(my u(1)»x«2 + my u(2)««2 + my u(3) x«2) x« (1.5) 
rhs(5) = -MSun«G«my u(2)/(my u(1)»«2 + my u(2)««2 + my u(3) x«2) x« (1.5) 
rhs(6) = -MSun«xG«my u(3)/(my u(1)»x«2 + my u(2)««2 + my u(3) x«2) x« (1.5) 


end subroutine calcrhs 


Command of gnuplot that represent time series of coordinates x, y, z: 
gnuplot- ploti SunmPlameite sic alte ae Waele se tlele: Sum want M Mr Mt 
For the trajectories in three dimensions, 


gnuplot> splot 'SunPlanets.dat' u 2:3:4 w 1 
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Chapter 3 


Code [ SchroedingerImplicit.f90 ] solves the 1+1 Schrödinger equation for 
the particle in a box and in a harmonic trap potential from Sect. 3.5: 


! Author: Francisco S. Guzman 
! Last modified: 17/January/2023 
! Purpose: Solves the IVP for the 1«1 Schroedinger Equation 
! using the CTCS Implicit Crank-Nicolson method 
! Parameters to experiment with: nodes, potential 
! Output file: SchroedingerImplicit.dat 
! Output: x Re (psi) Im(psi) rho exact (Re (psi)) 
! error (exact (Re(psi))) 
one data block per 8000 iterations 
! Output file: SchroedingerImplicit.fancy 
! Output: t x Re (psi) Im(psi) rho 
! one data block per 8000 iterations 
! Output file: SchroedingerImplicit.norms 
! t L1 (error) L2 (error) 


program SchroedingerImplicit 
implicit none 


! Arrays, Global Variables and Parameters 


real(kind=8), allocatable, dimension(:) :: x 

complex (kind=8), allocatable, dimension(:) :: psi,psi p 
complex(kind-8), allocatable, dimension (:) :: a,b,c,d,aux 
complex(kind-8) alpha,tmp 

real(kind-8), allocatable, dimension(:) :: rho,V,Hermite 


real(kind-8), allocatable, dimension(:) :: exact, error 
real(kind-8) pi,dx,dt,xmin,xmax,tmax,CFL,t,L1,L2,En,NofP 
real (kind=8) 

integer i,k,n,Nx,Nt,resolution_label,nodes 

character (len=20) :: potential 


factorial 


! Define some parameter values 

resolution label = 1 

nodes = 3 1 Quantum number 

CFL = 0.125 

pi - acos(-1.0d0) 

potential - 'harmonic trap' ! [ box, harmonic trap ] 


if (potential.eq.'box') then 


Nx - 100 
Nt - 1000000 
xmin = 0.0d0 


xmax = 1.0d0 
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else if (potential.eq.'harmonic trap') then 


Nx - 2000 
Nt - 1000000 
xmin = -10.0d0 
xmax = 10.0d0 
end if 
Nx = Nx « 2x«(resolution label-1) 
Nt = Nt « 2x«x(2«(resolution label-1) 


! Allocate memory for the various arrays 
allocate (x(0:Nx)) 

allocate(psi(0:Nx),psi p(0:Nx)) 
allocate(exact(0:Nx),error(0:Nx)) 
allocate(rho(0:Nx),V(0:Nx),Hermite(0:Nx)) 
( 


allocate(a(0:Nx),b(0:Nx),c(0:Nx),d(0:Nx) , aux(0:Nx)) 


Lx: space coordinate 

! psi: wave function at time n+1 

1 psi p: wave function at time n 

! exact: exact solution 

! error: error 

fo a,b;c: arrays for the three diagonals of the matrix 
1 d: right hand side of the linear system 

l aux: array for the forward-backward substitution 
1 Hermite: arrays to store Hermit polynomials 

I V: potential 


1 Numerical Domain 
dx = (xmax-xmin) /dble (Nx) 
dt = CFL + dx««2 
do i=0,Nx 
x(i) = xmin + dble(i) +» dx 
end do 
alpha = cmplx( 0.0d0 , 0.25d0*dt/dxx«2 


! INITIAL DATA 
if ( potential.eq.'box' ) then 


psi = emplx( sqrt(2.0d0) « sin(dble(nodes) * pi * x) , 0.0d0 
V = 0.0d0 1 Potential 
En = 0.5d0« (dble (nodes) «pi) **«2 ! Energy, useful for the exact solution 
l ----------------------------------- 
else if ( potential.eq.'harmonic trap' ) then 


! Harmonic oscillator 


Hermite = 1.0 

else if (nodes.eq.1) then 
Hermite = 2.0«x 

else if (nodes.eq.2) then 


Hermite = 4.0«x««2 - 2.0 
else if (nodes.eq.3) then 
Hermite = 8.0«x««3 - 12.0*x 


else if (nodes.eq.4) then 
Hermite = 16.0*x**4 - 48.0«x*«2 + 12.0 
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end if 
factorial - 1 
do i = 2, nodes 
factorial = factorial « i 
end do 
psi = 1.0d0/sqrt( sqrt(pi)«2.0««nodes«factorial ) & 
xexp(-x««2/2.0) «Hermitexcmplx(1.0d0,0.0d0) 


V = 0.5d0 « Xx*2 ! Potential 
En = dble( nodes ) + 0.5d0 ! Energy, useful for the exact solution 
l ----------------------------------- 

end if 

exact = real (psi) 

rho = real(psi)««2 + imag(psi) *«2 


open (1, file=’SchroedingerImplicit.dat’) 
open (2, file=’SchroedingerImplicit.fancy’ ) 
open (3, file=’SchroedingerImplicit.norms’ ) 


! Saves data at initial time 
do i=0,Nx,2** (resolution_label-1) 
write(1,«) x(i),real(psi(i)),imag(psi(i)),rho(i),exact(i),0.0 
end do 
write(1,xx) 
write(1,xx) 
do i=0,Nx,2** (resolution label-1) 
write(2,*) t,x(i),real(psi(i)),imag(psi(i)),rho(i) 
end do 
write(2,xx) 
print +, ‘Iteration, Time' 


print +, 'O 0' 


1 Evolution loop 


do n-1,Nt 
EosoE x dt ! Updates time 
Io mS LOOP CORE gres 


! Recycle arrays 
psip - psi 


if ( potential.eq.'box' ) then 

! ZERO boundary conditions for PARTICLE in a BOX 

b(0) = 1.0d0 + 2.0d0*alpha+cmp1x (0.0d0,0.5d0*dt*V(0) 

c(0) - 0.0d0 

a(Nx) = 0.0d0 

b(Nx) = 1.0d0 + 2.0d0«alpha«emplx(0.0d0,0.5d0«dt«V (Nx) ) 

d(0) = psi p(0) « ( 1.0830-2.0d0«xalpha«emplx(0.0d0,-0.5d0«dt«V(0)) ) 

d(Nx) = psi p(Nx) « ( 1.0d0-2.0d0«alpha «ecmplx(0.0d0,-0.5d0«dt«V(Nx)) ) 
else if ( potential.eq.'harmonic trap' ) then 

! Boundary conditions for the Harmonic Oscillator 

b(0) = 1.0d0 + 2.0d0*alpha+cmp1x (0.0d0,0.5d0*dt*V(0) 

c(0) = -2.0d0 « alpha » psi(1) 

a(Nx) = -2.0d0*alphax*psi (Nx-1) 

b(Nx) = 1.0d0 + 2.0d0«xalpha«emplx(0.0d0,0.5d0«dt«V (Nx) ) 

d(0) = psi p(0) * ( 1.030-2.0d0xalpha«emplx(0.0d0,-0.5dO«dt«V(0)) ) & 


+ 2.0d0«psi p(i) 
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d(Nx) = psi p(Nx) * ( 1.0d0-2.0d0«alpha «emplx(0.0d0,-0.5d0«dt«V(Nx)) ) & 
+ 2.0d0«alpha«psi p(Nx-1) 
end if 


! Entries of Matrix A and vector d for inner points 
do i-1,Nx-1 


a(i) = -alpha 

b(i) = 1.0d0«2.0d0«alpha«emplx(0.08d0,0.5d0«dt«V(i)) 

c(i) = -alpha 

d(i) = psi_p(i-1)*alpha & 
+ psi p(i)«(1.0d0-2.0d0*«alpha«emplx(0.0d0,-0.5d0«dt«V(i)) ) & 
+ psi p(i«1)»«alpha 


end do 


! Tridiagonal system 
1 Forward substitution 


tmp = b(0) 
psi(0) = d(0)/tmp 
do i-1,Nx 
aux(i) = c(i-1)/tmp 
tmp = b(i)-a(i)*aux(i) 
psi(i) = (d(i)-a(i)*psi(i-1))/tmp 
end do 


! Backward substitution 
do i = Nx-1,0,-1 


psi(i) = psi(i) - aux(it+1)*psi(i+1 
end do 
lox i Ends Loop Core «--- 


1 Some diagnostics 
rho = real(psi)««2 + imag(psi) *«2 


! Exact Re(psi) 


if ( potential.eq.'box' ) then 

! For the particle in the box 

exact = sqrt (2.0)»cos (Ent) »sin(dble (nodes) *pixx) 
else if ( potential.eq.'harmonic trap' ) then 


! For the harmonic oscillator 
exact = 1.0d0/sqrt( sqrt(pi)«2.0««nodes«factorial )«xexp(-x««2/2.0) & 
x» Hermite « cos( En > t ) 
end if 


error - real(psi) - exact 


! Save data during the evolution every 8000 time-steps 


if (mod(n,8000«2««(2«(resolution label-1))).eq.0) then 
if (mod(n,2««(resolution label-1)).eq.0) then ! Regular output 
print x», n,t ! Send something to the screen 
write(1,*) "#_Time=",t 
do i=0,Nx,2** (resolution_label-1) 
write(1,«) x(i),real(psi(i)),imag(psi(i)),rho(i),exact (i) ,error (i) 
end do 


write(1,xx) 
write(1,xx) 
end if 
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1 Fancy output every 1000 time-steps 
write(2,x) 
do i=0,Nx,2«** (resolution_label-1) 
write (2,*) t,x(i),real(psi(i)),imag(psi(i)),rho(i) 
end do 
write (2,*) 


end if 


! Output of error norms and number of particles every 500 time-steps 
if (mod(n,500«2»«(2«(resolution label-1))).eq.0) then 
L1 = 0.0d0 
L2 = 0.0d0 
NofP = 0.0d0 
do i=1,Nx 
L1 = L1 + 0.5D0* (dabs(error(i-1)) + dabs(error(i)))*dx 
L2 = L2 + 0.5D0«*«(error(i-1)**2 + error(i) **2) «dx 
NofP = NofP + 0.5d0«(rho(i-1) + rho(i)) «dx 
end do 
L2 = sqrt (L2) 
write(3,*) t,L1,L2,NofP 
end if 


end do 
close (3) 
close (2) 


close (1) 


print +, 'Program, finished' 


end program 
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Chapter 4 


Code [ MoLWave.f90 ] solves the 1+1 wave equation using the MoL in Sect. 4.4: 


! Author: Francisco S. Guzman 

! Last modified: 17/January/2023 

1 Purpose: Solves the IVP for the 141 Wave Equation using the Method of Lines and RK2 
! Parameters to experiment with: amp, boundary conditions 

! Output file: MoLWave.dat 

1 Output: x phi psi pi exact error 
! one data block per 10 iterations 

! Output file: MoLWave.fancy 

1 Output: t 36 phi psi pi 

! one data block per 5 iterations 

! Output file: MoLWave.norms 

! È L1 (error) L2 (error) 


program MoLWave 


implicit none 


1 Arrays, Global Variables and Parameters 


real(kind-8), allocatable, dimension(:) :: x 

real(kind-8), allocatable, dimension(: phi,phi p,rhs phi 
real(kind-8), allocatable, dimension(: psi,psi p,rhs psi 
real(kind-8), allocatable, dimension(: pi, pi p, rhs pi 


) 

) 

) 

real(kind-8), allocatable, dimension(:) :: exact, error 
real(kind-8) dx,dt,xmin,xmax,tmax,CFL,t,amp,sigma,L1,L2 
integer i,n,Nx,Nt,resolution label,rk 


character(len-20) :: boundary conditions 


! Define some parameter values 


resolution label - 1 

Nx - 200 

Nx = 2x«(resolution label-1) +» Nx ! Number of cells for the discretized domain 
Nt = 400 * 2**(resolution_label-1) 

xmin = -1.0d0 

xmax = 1.0d0 

CFL = 0.5 

amp = 1.0d0 

sigma = 0.1 

boundary conditions = ‘outgoing’ 1 [ outgoing, periodic ] 


! Allocate memory for the various arrays 
allocate (x(0:Nx) ,exact (0:Nx) , error(0:Nx)) 
allocate (phi (0:Nx) ,phi_p(0:Nx) ,rhs_phi (0:Nx) ) 
allocate (psi (0:Nx) ,psi_p(0:Nx) ,rhs_psi(0:Nx) ) 
allocate (pi(0:Nx), pi p(0:Nx), rhs pi(0:Nx) ) 


1x: Space coordinate 
1 phi: phi at time n+1 
! psi: psi at time n1 


334 Appendix B: Codes 


! pi: pi at time n«1 
! phi p: phi at time n 
! psi p: psi at time n 
! pi p: pi at time n 

! rhs phi: rhs (phi) 

! rhs psi: rhs (psi) 

! rhs pi: rhs (pi) 

1 exact: exact solution 
! error: error 


1 Numerical Domain 


dx = (xmax-xmin) /dble (Nx) 
dt = CFL « dx 
do i=0,Nx 
x(i) = xmin + dble(i) » dx 
end do 


! Initialize arrays and time 


t = 0.0d0 
phi = 0.0d0 
psi - 0.0d0 
pi = 0.0d0 
phi p = 0.0d0 
psi p - 0.0d0 
pip - 0.0d0 
rhs phi - 0.0d0 
rhs psi - 0.0d0 
rhs pi - 0.0d0 
exact - 0.0d0 
error - 0.0d0 


1 Initial conditions 
phi = ampxexp(-x**2/sigmax*2) 


psi = -2.0d0*x/sigmas*2 *phi 
pi = 0.0d0 
exact = ampxexp(-x««2/sigma««2) 


open (1,file='’MoLWave.dat’ ) 
open (2, file='’MoLWave.fancy’ ) 
open (3, file='’MoLWave.norms’ ) 


! Saves data at initial time 


write(1,*) "#_Time=",t 
do i=0,Nx 
write(1,*) x(i),phi(i),psi(i),pi(i),exact(i),0.0 
end do 
write (1,x) 
write (1, x) 
do i=0,Nx 
write(2,*) t,x(i),phi(i),psi(i),pi(i) 
end do 
write (2,x) 


print «, ‘Iteration, Time' 


print s; 'O ...zsejsacsitus0" 
1 Evolution loop 
do n-1,Nt 
torzet 4 dt ! Updates time 
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1ox*k*** TU» LOOP CORE 


! Recycle arrays 


phi p - phi 
psi p - psi 
pip - pi 
! Heun RK2 
do rk-1,2 


1 Calculate the RHS 
do i-1,Nx-1 
rhs psi(i) = 0.5d0 +» 


rhs pi(i) = 0.5d0 « 
rhs phi(i) = pi(i) 
end do 


ce 


( pi(i-1) - pi(i-1) ) / dx 
( psi(i-«1) - psi(i-1) ) / dx 


if ( boundary conditions.eq.'outgoing' ) then 


! Outgoing wave boundary conditions 


rhs phi(0) = - 0.5d0 + 
rhs phi(Nx) = - 0.5d0 « 
else if ( boundary conditions.eq.'periodic' ) then 


( phi(2) - 4.0d0*phi (1) 
( phi(Nx-2) - 4.0d0xphi (Nx-1) 


! Periodic boundary conditions 


rhs psi(0) = 0.5d0 * 
rhs pi(0) = 0.5d0 « 
rhs phi(0) = pi(Nx) 

rhs psi(Nx) = 0.5d0 + 
rhs pi(Nx) = 0.5d0 + 


rhs phi (Nx) 
end if 


pi (Nx) 


if (rk.eq.1) then 
psi psi p + rhs psi 
pi -pip + rhs pi 
phi = phi p + rhs phi 


( 
( 


psi = 0.5d0 « ( psi p + 


pi = 0.5d0 * ( pip 
phi = 0.5d0 « ( phi p 
end if 


pi(1) 


+ 3.0d0 » phi(0) 


pi(Nx-1) ) / dx 


psi(1) - psi(Nx-1) ) / àx 


pi(1) - pi(Nx-1) ) / dx 
psi(1) - psi(Nx-1) ) / dx 


dt 
dt 
dt 


psi + rhs psi » dt) 


+ pi + rhs pi * dt) 


phi + rhs phi » dt) 


if ( boundary conditions.eq.'outgoing' ) then 


! Outgoing wave boundary conditions -- comment these 4 lines out 
if you use periodic BCs 
psi(0) = - 0.5d0 * ( phi(2) - 4.0d0*phi(1) + 3.0d0«phi(0)) / dx 
pi(0)  - psi(0) 
psi(Nx) = 0.5d0 « ( phi(Nx-2) - 4.0d0*phi(Nx-1) + 3.0d0 * phi (Nx) 
pi(Nx) = -psi (Nx) 
end if 

end do 

l kek RE ---» Ends Loop Core «--- 

if ( boundary conditions.eq.'outgoing' ) then 


1 Exact solution only for outgoing wave BCs 


exact = 0.5d0 « amp « exp(-( x - t )««2 / sigma««2) & 


+ 0.5d0 « amp x exp(-( x + t )««2 / sigma««2) 


else if ( boundary conditions.eq.'periodic' ) then 


! An exercise is to code the exact solution for periodic BCs 


end if 


error - phi - exact 


! Save data during the evolution every 10 time-steps 


) 


) 


/ dx 


+ 3.0d0 * phi (Nx) 


/ dx 
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if (mod(n,10«2««(resolution label-1)).eq.0) then ! Regular output 
print «, n,t 1 Send something to the screen 
write(1,«) "i Time-",t 


do i=0,Nx,2«** (resolution_label-1) 
write(1,*) x(i),phi(i),psi(i),pi(i),exact (i) ,error (i) 
end do 
write (1,*) 
write (1,x) 
end if 


if (mod(n,5«2««(resolution label-1)).eq.0) then 
! Fancy output every 5 time-steps 
write(2,») 


do i-0,Nx 
write(2,*) t,x(i),phi(i),psi(i),pi(i) 
end do 


write(2,») 
end if 


! Norms of the error 


L1 = 0.0d0 

L2 = 0.0d0 

do i-1,Nx 
L1 = L1 + 0.5D0«(dabs(error(i-1)) + dabs(error(i)))*dx 
L2 = L2 + 0.5D0«* (error(i-1)**2 + error(i) **2)*dx 

end do 


L2 = sqrt (L2) 
write(3,*) t,L1,L2 


end do 

close (3) 
close (2) 
close (1) 


print +, 'Program,finished' 


end program 


Command of gnuplot used to produce the plots for $, Y, and x in Figs. 4.5 and 4.6 uses 


gnuplot» splot 'MoLWave.fancy' u 1:2:3 t 'phi' w 1 
gnuplot» splot 'MoLWave.fancy' u 1:2:4 t 'psi' w 1 
gnuplot» splot 'MoLWave.fancy' u 1:2:5 t 'pi' w 1 


Norms L and L» are plotted with 


gnuplot> plot 'MoLWave.norms' t 'L1 norm of error’ w 1 
gnuplot> plot 'MoLWave.norms' u 1:3 t 'L2 norm of error’ w 1 


that will work only for outgoing wave boundary conditions, because it is the case the exact 
solution is calculated for. Try coding the exact solution for periodic boundary conditions. 
Snapshots of the wave function as in Fig. 4.7 use 


(continued) 


Appendix B: Codes 337 


gnuplot» plot 'MoLWave.dat' i 0:10000:400 t 'phi through the 
Greep vy Ji 


appropriate for periodic boundary conditions. 


Chapter 5 


Code [ MoLEuler.f90 ] solves the 1+1 Euler equations for an ideal gas in Sect. 5.2: 


! Author: Francisco S. Guzman 

! Last modified: 17/January/2023 

1 Purpose: Solves the IVP for the 1+1 Euler Equations for the shock-tube problem 
1 using HLLE-minmod and RK2 

! Parameters to experiment with: states L and states R 
! Output file: MoLEuler.dat 

1 Output: x rho v E p 

1 one data block per 100 iterations 

1 Output file: MoLEuler.fancy 

! Output: t x rho v E p 
1 one data block per 50 iterations 


module global numbers 


1 --- Numerical domain 

real(kind-8), allocatable, dimension(:) :: x 
real(kind-8) dx,dt,xmin,xmax,tmax,CFL,t 
integer Nx,Nt,resolution label,rk 


1 --- Primitive variables 
real(kind-8), allocatable, dimension(:) :: rho,p,v,E,cs 


! --- Conservative variables 


real(kind-8), allocatable, dimension(:) :: ul,ul p,rhs ul 
real(kind-8), allocatable, dimension(:) u2,u2 p,rhs u2 
real(kind-8), allocatable, dimension(:) u3,u3 p,rhs u3 

l! --- Fluxes 

real(kind-8), allocatable, dimension(:) :: fluxl,flux2,flux3 
real(kind-8) pL,pR,rhoL,rhoR,vL,vR,csL,csR,ulL,ulR,u2L,u2R,u3L,u3R 


kind-8) lambdalL,lambda2L,lambda3L,lambdalR,lambda2R,lambda3R 

kind-8) lambdal plus,lambda2 plus,lambda3 plus,lambdal minus,lambda2 
minus,lambda3 minus 

real(kind-8) f1L,f2L,f3L,f1R,f2R,f3R 


( 
( 
( 
( 


1 --- Hydrodynamics 
real(kind-8) gamma 
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! Shock-Tube initial data 
real(kind-8) rhoL ini,rhoR ini,pL ini,pR ini,vL ini,vR ini 


character (len=20) :: reconstructor 


end module 


program Euler 


use global_numbers 
implicit none 


integer i,n 


! Define some parameter values 


resolution_label = 1 

Nx = 1000 

Nx = 2x» (resolution_label-1) » Nx ! Number of cells for the discretized domain 
Nt = 1000 * 2««(resolution label-1) 

xmin = 0.0d0 

xmax = 1.0d0 

CFL = 0.25 

rhoL_ini = 1.0 

rhoR_ini = 0.125 

vL_ini = 0.0 

vR_ini = 0.0 

pL_ini = 50 

pR_ini = 0.1 

gamma = 1.4 

reconstructor = ‘’monmod’ ! [ minmod, godunov ] 


! Allocate memory for the various arrays 
allocate (x(0:Nx) ) 


allocate (cs (0:Nx) ) 
allocate (flux1(0:Nx) , flux2 (0:Nx) , £lux3 (0:Nx) ) 


allocate (ul (0:Nx) ,ul_p(0:Nx) ,rhs_ul1(0:Nx) ) 
allocate (u2(0:Nx) ,u2_p(0:Nx) ,rhs_u2(0:Nx) ) 
allocate (u3 (0:Nx) ,u3_p(0:Nx) ,rhs_u3 (0:Nx) ) 
allocate (rho (0:Nx) ,p(0:Nx) ,v(0:Nx) , E(0:Nx)) 
( 
( 


1ox: Space coordinate 

1 ui: conservative variable i 
1 rho: density 

Ip: pressure 

lov: velocity 

I E: total energy 

T ess sound speed 

1 fluxi: flux i 


1 Numerical Domain 
dx = (xmax-xmin) /dble (Nx) 
dt = CFL + dx 
do i=0,Nx 
x(i) = xmin + dble(i) * dx 
end do 
! Initial conditions for the shock tube 
do i=0,Nx 
if (x(i).le.0.5d0) then 
rho(i) 
p(i) 


rhoL ini 


pL ini 
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v (i) - vL ini 
else 
rho(i) - rhoR ini 
p(i) = pR ini 
v (i) - vR ini 
end if 
end do 
E = p/rho/(gamma - 1.0D0) + 0.5D0 « rho +» vxx«2 


1 Definition of Conservative Variables 


ul - rho 
u2 = rho * v 


u3 = p/(gamma - 1.0D0) + 0.5D0 « rho + vxx2 


open(1,file-'MoLEuler.dat') 
open(2,file-'MoLEuler.fancy') 


B AAA Save data at initial time 


write(1,«) "#_Time=",t 
do i-0,Nx 


write(1,«) x(i),rho(i),v(i),E(i),p(i) 


end do 

write(1,x) 
write(1,») 
do i-0,Nx 


write(2,«) t,x(i),rho(i),v(i),E(i),p(i) 


end do 
write(2,») 


print *, ‘Iteration, Time’ 


print x, ‘0 0* 


1 Evolution loop 
DO n-1,Nt 


t-2tedt ! Updates time 
Doxk*keke ARAS LOOP CORE gnp 


! Recycle arrays 


ul_p = ul 
u2_p = u2 
u3_p = u3 
! Heun RK2 
do rk-1,2 


! ---» (a) Reconstruct variables «--- 

l ------------- 

fo ----- > Calculate primitive variables 
rho = ul 

v = u2/ul 

p = (gamma - 1.0D0)*(u3 - 0.5D0xu2««2/u1) 


E=p/ (ul +» (gamma - 1.0D0) 
cs = sqrt( p +» gamma / rho ) 


do i=0,Nx-1 
call reconstruct (p(i-1),p(i), 
call reconstruct( 
call reconstruct( 
( 


(i 
call reconstruct (cs(i-1),cs( 


) 


1),v(i),v 


P 
rho(i-1),rho(i 
v 
c i),cs 


+ 0.5DO * rho * vxx2 


p(i-1),p(i«2),dx,pL,pR) 
dx,rhoL,rhoR) 
(i-«1),v(i«2),dx,vL,vR) 
(i-1),cs(i«2),dx,csL,cSsR) 


),rho(i«1),rho(i-«2), 
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ulL - rhoL 
u2L = rhoL * vL 
u3L = pL/ (gamma 
ulR = rhoR 
u2R = rhoR * vR 
u3R = pR/ (gamma 


lambdalL = vL - 
lambda2L = vL 
lambda3L = vL + 


lambdalR = vR - 
lambda2R = vR 
lambda3R = vR + 


lambdal_plus = 
lambdal_minus = 
lambda2_plus = 
lambda2_minus = 
lambda3_plus = 
lambda3_minus = 


1 ---> (d) «--- 


f2L = 0.5d0«(3. 
f2R = 0.5d0«(3. 


f3L = gamma * u 
f3R = gamma x u 


Fh 
H 
[s 
x 
e 
T 

[] 


flux2(i) 


flux3 (i) 


Appendix B: Codes 


- 1.0D0) + 0.5D0 * rhoL » vL«*2 


- 1.0D0) + 0.5D0 * rhoR «» vR««2 


Calculate the eigenvalues at L and R 


csL 
csL 
csR 


csR 


Calculate lambda_plus and lambda_minus 


max (0.0d0, lambdalR, lambdaiL, lambda2L, lambda2R, lambda3L, lambda3R) 
min (0.0d0, lambdal1R, lambdaiL, lambda2L, lambda2R, lambda3L, lambda3R) 
max (0.0d0, lambdalR, lambdalL, lambda2L, lambda2R, lambda3L, lambda3R) 
min (0.0d0, lambdal1R, lambdaliL, lambda2L, lambda2R, lambda3L, lambda3R) 
max (0.0d0, lambdalR, lambdaiL, lambda2L, lambda2R, lambda3L, lambda3R) 
min(0.0d0,lambdalR,lambdalL,lambda2L,lambda2R,lambda3L,lambda3R) 


Calculate the fluxes at L and R 


Odo - gamma)«u2L««2/ulL + (gamma - 1.0d0) * u3L 
0d0 - gamma)«u2R««2/ulR + (gamma - 1.0d0) « u3R 


2L « u3L / ulL - 0.5d0 « ( gamma - 1.0d0) * u2L««3 / ulL««2 
2R * u3R / ulR - 0.5d0 * ( gamma - 1.0d0) * u2R**3 / ulR**2 


ambdal plus +» f1L - lambdal minus » f1R & 
ambdal plus +» lambdal minus * (ulR - ulL) ) & 
ambdal plus - lambdal minus) 


ambda2 plus + f2L - lambda2 minus * f2R & 
ambda2 plus * lambda2 minus « (u2R - u2L) ) & 
ambda2 plus - lambda2 minus) 


ambda3 plus * f3L - lambda3 minus » f3R & 
ambda3 plus * lambda3 minus « (u3R - u3L) ) & 
ambda3 plus - lambda3 minus) 


! ---» (f) «--- We have now the RHSs for the MoL 
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rhs ul(i) = - ( fluxi(i) - fluxl(i-1) ) / dx 

rhs u2(i) = - ( flux2(i) - flux2(i-1) ) / dx 

rhs u3(i) = - ( flux3(i) - flux3(i-1) ) / dx 
end do 


if (rk.eq.1) then 
ul = ul p + rhs ul * dt 
u2 = u2 p + rhs u2 + dt 
u3 = u3 p + rhs u3 * dt 


ul = 0.5d0 « ( ul p + ul + rhs ul « dt) 
u2 = 0.5d0 +» ( u2 p + u2 + rhs u2 « dt) 
u3 = 0.5d0 « ( u3 p + u3 + rhs u3 « dt) 


end if 
l ------------- 
1 ---» (g) «--- Boundary conditions 
l ------------- 
ul(0) = u1(1) 
u2 (0) = u2(1) 
u3 (0) = u3 (1) 
ul (Nx) = ul (Nx-1) 
u2 (Nx) = u2(Nx-1) 
u3 (Nx) = u3(Nx-1) 
l ------------- 
1 ---» (h) «--- Recover primitive variables for output 
l ------------- 
rho - ul 
v = u2/ul 
p = (gamma - 1.0D0)*(u3 - 0.5D0xu2««2/u1) 
E-p/ (ul +» (gamma - 1.000) ) + 0.5DO « rho « v««2 
cs = sqrt( p * gamma / rho ) 
end do 
l kek RE “==> Ends Loop Core «--- 


1 Exact solution IF EXCERCISE SOLVED 
! Save data during the evolution every 100 time steps 


if (mod(n,100«2*«(resolution label-1)).eq.0) then ! Regular output 
print +, n,t ! Send something to the screen 
write(1,«) "fH Time-",t 
do i=0,Nx,2«* (resolution_label-1) 
write(1,«) x(i),rho(i),v(i),E(i),p(i) 
end do 
write(1,x) 
write (1,*) 
end if 


if (mod(n,50«2««(resolution label-1)).eq.0) then 
! Fancy output every 50 time steps 
write(2,x) 
do i-0,Nx 
write(2,*) t,x(i),rho(i),v(i),E(i),p(i) 
end do 
write(2,») 
end if 
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END DO 


close(2) 
close(1) 


print +, 'Program, finished' 


end program 


subroutine reconstruct (var0,varl,var2,var3,dspace, outL, outR) 


use global_numbers 
implicit none 


real(kind=8), intent (in) :: var0,varl,var2,var3,dspace 
real(kind=8), intent(out) :: outL,outR 

real (kind=8) smaxL,sminL,sigmaL,smaxR,sminR,sigmaR 
real (kind=8) minmod 


if (reconstructor.eq.'monmod') then 


smaxL - ( var2 - varl ) / dspace 
sminL = ( varl - var0 ) / dspace 
sigmaL = minmod(sminL,smaxL) 


smaxR = ( var3 - var2 ) / dspace 
sminR = ( var2 - varl ) / dspace 
sigmaR = minmod(sminR,smaxR) 


outL 
outR 


varl + sigmaL * 0.5d0 * dspace 
var2 - sigmaR « 0.5d0 * dspace 


else if (reconstructor.eq.'godunov') then 


outL = varl 
outR - var2 
end if 


real(kind-8) function minmod (a,b) 


implicit none 


real(kind-8) a,b 


minmod = 0.5d0«(sign(1.0D0,a) + sign(1.0D0,b))xmin(abs(a),abs(b)) 


end function minmod 
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Command of gnuplot used to produce results like those in Figs. 5.7, 5.8, 5.9, 5.10, 


and 5.11 for density, pressure, velocity, and internal energy: 
gnuplot» splot 'MoLEuler.dat' u 1:2 w 
gnuplot» splot 'MoLEuler.dat' u 1:3 
gnuplot» splot 'MoLEuler.dat' u 1:4 
gnuplot» splot 'MoLEuler.dat' u 1:5 


EX ES EX 
PRR 
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Code [ Schroedinger3p1.f90 ] solves the 3+1 Schrödinger equation using the 


implicit Crank-Nicolson method and the ADI scheme in Sect. 6.4: 


! Author: Francisco S. Guzman 
! Last modified: 3/March/2023 


! Purpose: Solves the 3+1 Schroedinger equation for the particle in a box and 


in a harmonic oscillator 
! It uses the ADI Implicit Crank-Nicolson Method 
! Parameters to experiment with: nodes, potential 
! Output file: psi.t 


! Output: iei N <K>+<V> Re(psi) (at origin) rho(at origin) 


! Output file: psi.x 

1 Output: x Re(psi)(at x-axis) Im(psi)(at x-axis) Re(psiexact) 
(at x-axis) error(at x-axis) 

! Output file: psi.xy 


1 Output: x y Re (psi) (at xy-plane) Im(psi) (at xy-plane) rho(at xy-plane) 


Module with global numbers 


module numbers 


! Arrays 

real(kind-8), allocatable, dimension(:,:,:) :: x,y,z 

complex(kind-8), allocatable, dimension psi,psi p,exact,error,V 

real(kind-8), allocatable, dimension(:, Hermitex,Hermitey,Hermitez 

real(kind-8), allocatable, dimension(:, :) :: rho,k integrand,v integrand 
complex(kind-8), allocatable, dimension (:) :: a,b,c,d,aux cn 


complex(kind-8) alpha,beta,tmp 
real(kind-8) NofP,ExpectationK,ExpectationV 


1 Numbers 

real(kind-8) dx,dy,dz,dt,xmin,xmax,ymin,ymax,zmin,zmax,tmax,CFL,t,r,pi 
real(kind-8) norm factor,nodes x,nodes y,nodes z,facnx,facny,facnz,Energy 
integer Nx,Ny,Nz,Nt,ifac,jfac,kfac 

character (len=20) potential 


end module 


program Schroedinger3p1 


use numbers 
implicit none 


integer i,j,k,n 


l ---------- Initial Set Up for the BOX and the HO ---------- 


potential = ‘oscillator’ ! [ box or oscillator ] 
Nx = 100 
Ny = 100 
Nz = 100 
Nt = 100000 
if (potential.eq.’box’) then 
xmin = 0.0d0 
xmax = 1.0d0 
ymin = 0.0d0 
ymax = 1.0d0 
zmin = 0.0d0 
zmax = 1.0d0 


nodes_x = 3.0d0 
nodes_y = 3.0d0 


nodes z 


3.0d0 


else if (potential.eq.'oscillator') then 


xmin = -5.0 
xmax = 5.0 
ymin = -5.0 
ymax = 5.0 
zmin = -5.0 
zmax = 5.0 


5 
[e 
a 
o 
a 

l 
* 
D 
N 
o 
2 
[o] 


5 
[e 
a 
o 
a 

| 
N 
D 
N 
o 
2 
o 


end if 
CFL = 1.0 
pi - acos(-1. 


odo) 


! Alocate memory of arrays 


allocate(x(0:Nx,0:Ny,0:Nz) , y (0:Nx,0:Ny,0:Nz) , Z(0: Nx, 0:Ny,0:Nz)) 


allocate(psi(0:Nx,0:Ny,0:Nz),psi p(0:Nx,0:Ny,0:Nz)) 
allocate (rho (0:Nx,0:Ny,0:Nz) ) 


Appendix B: Codes 


allocate (V(0:Nx,0:Ny,0:Nz) , exact (0:Nx,0:Ny,0:Nz) ,error(0:Nx,0:Ny,0:Nz) ) 

allocate (Hermitex(0:Nx,0:Ny,0:Nz) ,Hermitey (0:Nx,0:Ny,0:Nz) , Hermitez (0:Nx,0:Ny,0:Nz)) 
1 For Nx-Ny-Nz this simplifies allocation for a,b,c,d 
allocate (a(0:Nx),b(0:Nx),c(0:Nx),d(0:Nx),aux cn(0:Nx)) 


( 
( 
allocate(k integrand(0:Nx,0:Ny,0:Nz),v integrand(0:Nx,0:Ny,0:Nz)) 
( 
( 


Uy, m: 

! psi: 

! psi p: 

! exact: 

! error: 

ay bye? 

1d: 

! aux cn: 

1 Hermitex(yz): 
! k integrand: 
! v integrand: 


Space coordinates 

wave function at time n+1 

wave function at time n 

exact solution 

error 

arrays for the three diagonals of the matrix 
right hand side of the linear system 

array for the forward-backward substitution 
arrays to store Hermit polynomials 


integrand of the expectation value of kinetic energy 


integrand of the expectation value of potential energy 
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1 Numerical Domain 


dx = (xmax-xmin) /dble (Nx) 
dy = (ymax-ymin) /dble (Ny) 
dz = (zmax-zmin) /dble (Nz) 
dt = CFL + min(dx**2,dy**2,dz**2) 
do i=0,Nx 

x(i,:,:) = xmin + dble(i) * dx 
end do 
do j=0,Ny 

y(:,j,:) = ymin + dble(j) * dy 
end do 
do k=0,Nz 

z(:,:,k) = zmin + dble(k) +» dz 
end do 


alpha = cmplx( 0.0d0 , 0.25d0 * CFL ) 
beta = cmplx( 0.0d0 , 0.5d0 * dt) 


! Initial Data 
if (potential.eq.'box') then 


V emplx( 0.0dO , 0.0d0 
psi = emplx(sqrt(8.0d0) * sin(nodes_x*pixx) * sin(nodes_y*pixy) * 


sin(nodes z«pi«z),0.0d0) 
else if (potential.eq.'oscillator') then 


V = emplx( 0.5d0 « ( X**2 + yx*«2 + Zex2 ) , 0.0d0 ) 
1 Normalization coefficients 
facnx = 1.0d0 
1.0d0 
facnz 1.0d0 
do ifac-2,int(nodes x) 
facnx = facnx » dble(ifac) 


facny 


end do 
do jfac-2,int(nodes y) 

facny = facny +» dble(jfac) 
end do 
do kfac-2,int(nodes z) 

facnz = facnz » dble(kfac) 
end do 


! Only nx,ny,nz less than 5, written by hand 
if (nodes x.eq.0) then 
Hermitex - 1.0d0 
else if (nodes x.eq.1) then 
Hermitex = 2.000 + x 
else if (nodes x.eq.2) then 
Hermitex = 4.0d0 * x**2 - 2.0d0 
else if (nodes x.eq.3) then 
Hermitex = 8.0d0 * x**3 - 12.0 * x 
else if (nodes_x.eq.4) then 
Hermitex = 16. « xX**4 - 48. x X**2 + 12. 
end if 
if (nodes y.eq.0) then 
Hermitey - 1.0d0 
else if (nodes y.eq.1) then 
Hermitey = 2.080 * y 
else if (nodes y.eq.2) then 
Hermitey = 4.0d0 * yx«2 - 2.0d0 
else if (nodes y.eq.3) then 
Hermitey = 8.0d0 * yx«3 -12.0 * y 
else if (nodes y.eq.4) then 
Hermitey = 16. * y«x4 - 48. * yxe2 + 12. 
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end if 


if (nodes z.eq.0) 


Hermitez - 


else if (nodes z.eq.1) 


Hermitez - 


else if (nodes z.eq.2) 


Hermitez - 


else if (nodes z.eq.3) 


Hermitez - 


else if (nodes z.eq.4) 


Hermitez - 
end if 
norm factor 


psi - 


end if 


1 At initial time the numerical equals the exact solution 


exact - psi 


then 
1.0d0 


2.000 * z 


4.080 * z**2 


8.0d0 * zx«3 


16. * Ze*4 = 


then 


then 


then 


2 


.0dO 


-12.0*z 


then 


48.0 * Zzx«2 + 12. 


= 1.0d0 / sqrt( pi««(1.5) 


* facnx « facny « facnz 


, 0.0d0 ) 


open(1,file-'psi.t',status-'replace') 


close(1) 


open(2,file-'psi.x',status-'replace') 


close(2) 


open(3,file-'psi.xy',status-'replace') 


close(3) 


! Saves data at initial time 


call save scal 
call save axes 
call save plan 


print x,’ 
Energy, 


print x, 


ars 


on 


Iteration 


psi(0,0,0)' 
0,t,NofP, ExpectationK+ExpectationV, psi (Nx/2,Ny/2,Nz/2) 


! Evolution loop 


do n=1,Nt 


t=t + dt 
1ox***k -- 
! ADI 

psi p - psi 
fiume 
do j-1,Ny-1 
do k-1,Nz-1 


Step 1: 


! Updates time 


-» LOOP CORE 


Solution for R 


Time 


P" 


) 


* exp (-0.5d0«yx*2) 


ec 


! Boundary conditions on xmin and 


b(0) = 1.080 + 2.0d0*alpha 
b(Nx) = 1.0d0 + 2.0d0«alpha 
if (potential.eq.’box’) then 
c(0) = 0.0d0 
d(0) = psi_p(0,j,k) x ( 1.0d0 - 
a(Nx) = 0.0d0 
d(Nx) = psi p(Nx,j,k) + ( 1.0d0 - 
else if (potential.eq.'oscillator') 
c(0) = -2.0d0*alpha 
d(0) = psi_p(0,j,k) x ( 1.0d0 - 


+ 2.0d0xalpha«psi p(1,j,k) 


xmax 


2.0d0«alpha ) 


2.0d0«alpha ) 
then 


2.0d0«alpha ) 


cmplx(norm factor « Hermitex « Hermitey * Hermitez & 
* exp(-0.5d0«x««2) 


N-int (rho) 


& 


Appendix B: Codes 


* 2.x«nodes x » 2.««nodes y * 2.««nodes z & 


* exp(-0.5d0xz«*2) & 
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end if 


: Codes 


= -2.0d0xalpha 
= psi p(Nx,j,k) * ( 1.0d0 - 2.0d0«alpha ) 


+ 2.0d0«alphaxpsi p(Nx-1,j,k) 


! All other entries of the tridiagonal matrix 
do i-1,Nx-1 


a(i) = -alpha 
b(i) = 1.0d0 + 2.0d0«alpha 
c(i) = -alpha 
d(i) = psi p(i-1,j,k) * alpha & 
* psi p(i,j,k) * ( 1.080 - 2.0d0«alpha 
+ psi p(i«1,j,k) * alpha 
end do 
1 Forward substitution 
tmp = b(0) 
psi(0,j,k) = d(0)/tmp 
do i=1,Nx 
aux cn(i) = c(i-1)/tmp 
tmp = b(i) - a(i)*aux_cn(i) 
psi(i,j,k) = (d(i)-a(i)spsi(i-1,j,k))/tmp 
end do 


! Backward substitution 
Nx-1,0,-1 


do i = 


psi(i,j,k) = psi(i,j,k) - aux_cn(i+1)*psi(i+1,j,k) 


end do 
end do 
end do 


de scito 


S 


tep 2: Solution for S «--- 
! Refill the array for psi with the values obtained for R 


psi p - psi 

do i-1,Nx-1 

do k-1,Nz-1 
! Boundary conditions on ymin and 
b(0) = 
b(Ny) - 


d (Ny 


end if 


) 


0.0d0 
0.0d0 
psi p(i,0,k) x ( 1.0d0 
- psi p(i,Ny,k) « ( 1.0d0 


(potential.eq.’oscillator’ 
= -2.0d0*alpha 
= -2.0d0*alpha 
= psi_p(i,0,k) x ( 1.0d0 
+ 2.0d0«alpha«psi p(i,1,k) 


ymax 


) 


2.0d0«alpha 
2.0d0«alpha 
then 


2.0d0«alpha 


= psi p(i,Ny,k) « ( 1.0d0 - 2.0d0*alpha 
+ 2.0d0«alpha«psi p(i,Ny-1,k) 


! All other entries of the tridiagonal matrix 
do j-1,Ny-1 


a(j) = -alpha 
b(j) = 1.0d0 + 2.0d0«alpha 
c(j) = -alpha 
d(j) = psi(i,j-1,k) * alpha & 
+ psi(i,j,k) * ( 1.0d0 - 2.0d0«alpha ) 
+ psi(i,j+1,k) * alpha 
end do 
! Forward substitution 
tmp = b(0) 
psi(i,0,k) = d(0)/tmp 
do j=1,Ny 
aux cn(j) = c(j-1)/tmp 


tmp 


b(j)-a(j)xaux en(j3) 


& 


& 


& 
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psi(i,j,k) = (d(j)-a(j)*psi(i,j-1,k))/tmp 


end do 


! Backward substitution 
do j = Ny-1,0,-1 
psi(i,j,k) = psi(i,j,k) - aux_cn(j+1)*psi(i,j+1,k) 


end do 
end do 
end do 


TE Step 3: 


Solution for T Ea 


! Refill the array for psi with the values obtained for S 


psi p - ps 
do i-1,Nx- 
do j-1,Ny- 


i 
1 
1 


1 Boundary conditions on zmin and zmax 


b(0) = 1.080 + 2.0d0«alpha 
b(Nz) = 1.080 + 2.0d0«alpha 
if (potential.eq.’box’) then 
c(0) = 0.0d0 
a(Nz) = 0.0d0 
d(0) = psi(i,j,0) * ( 1.080 - 2.0d0«alpha 
d(Nz) = psi(i,j,Nz) «x ( 1.0d0 - 2.0d0xalpha 
else if (potential.eq.'oscillator') then 
c(0) = -2.0d0*alpha 
a(Nz) = -2.0d0*alpha 
d(0) = psi(i,j,0) * ( 1.0830 - 2.0d0*alpha ) & 
+ 2.0d0xalphaxpsi(i,j,1) 
d(Nz) = psi(i,j,Nz) * ( 1.0d0 - 2.0d0*alpha ) & 
+ 2.0d0xalpha«psi(i,j,Nz-1) 
end if 


! All other entries of the tridiagonal matrix 
do k-1,Nz-1 


a(k) - 


(k) = 
(k) = 
(k) = 
+ 
4 


end do 


-alpha 

1.0d0 + 2.0d0«a 
-alpha 

psi p(i,j,k-1) 
psi p(i,j,k) 
psi p(i,j,k«1) 


1 Forward substitution 
tmp = b(0) 
psi(i,j,0) = d(0)/tmp 


do k=1,Nz 
aux_cn(k) = c 
b(k) -a( 
psi(i,j,k) = 


tmp = 


end do 


(k-1) /tmp 
k) xaux_cn 
(d(k) -a(k 


! Backward substitution 
do k = Nz-1,0,-1 
psi(i,j,k) = psi(i,j,k 


end do 
end do 
end do 


l ---> Step 4: Solution 
! Refill the array for psi with the values obtained for T 


psi_p = psi 

! It is a diagonal system 
psi = (1.0d0 - beta » V) x 
! ***** ---» 


! Exact solution 


if (potential.eq.'box') 


Energy - 


0.5d0 * pi««2 x» 


lpha 

* alpha & 

* (1.0d0 - 2.0d0*alpha ) & 
* alpha 

(k) 

)*psi(i,j,k-1))/tmp 


) - aux_cn(k+1)*psi(i,j,k+1) 


for Psi at time ntl <--- 


psi / (1.0d0 + beta « V ) 


Ends Loop Core irm 


then 


( nodes x««2 + nodes y««2 + nodes z««2 ) 
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exact = sqrt(8.0d0)«sin(nodes x*xpi»x)«sin(nodes y«pi«y)»sin(nodes zx»pi«z) 
emplx( cos( Energy « t) , sin( Energy x t ) ) 
else if (potential.eq.'oscillator') then 
Energy = nodes x + nodes y + nodes z + 1.5d0 
exact = norm factor « Hermitex « Hermitey * Hermitez & 
exp(-0.5d0xx««2) «x exp(-0.5d0«yx«2) * exp(-0.5d0xz«*2) & 
cmplx( cos( Energy « t) , sin( Energy x t ) ) 


+ 


* 


error - psi - exact 
! Save data during evolution every 100 time steps 


if (mod(n,100).eq.0) then 1 Output every certain # of iterations 

call save scalars 

call save axes 

call save planes 

print +», n,t,NofP,ExpectationK+Expectationv ! Send something to the screen 
end if 


end do 
print +, 'Program, finished' 


end program 


subroutine save scalars 


use numbers 
implicit none 


integer i,j,k 


rho = conjg(psi)*psi ! For the integration of N 
k integrand = 0.0d0 ! For the expectation value of kinetic energy 
do i-1,Nx-1 
do j-1,Ny-1 
do k-1,Nz-1 
k integrand(i,j,k) = real(psi(i,j,k)) * ( & 


( real(psi(i«1,j,k)) - 2.0d0 » real(psi(i,j,k)) + real(psi(i-1,j,k)) 
/ dx**2 & 
+ ( real(psi(i,j«1,k)) - 2.0d0 * real(psi(i,j,k)) + real(psi(i,j-1,k)) 
/ dy**2 & 
+ ( real(psi(i,j,k«1)) - 2.0d0 * real(psi(i,j,k)) + real(psi(i,j,k-1)) 
/ dzx«2 ) & 
+ imag(psi(i,j,k)) * ( & 
( imag(psi(i+1,j,k)) - 2.0d0 « imag(psi(i,j,k)) + imag(psi(i-1,j,k)) 
/ dx**2 & 
+ ( imag(psi(i,j+1,k)) - 2.080 « imag(psi(i,j,k)) + imag(psi(i,j-1,k)) 
/ dyxx2 & 
+ ( imag(psi(i,j,k+1)) - 2.0d0 « imag(psi(i,j,k)) + imag(psi(i,j,k-1)) 
/ dzx«2 ) 
end do 
end do 
end do 


! Copy the value of the integral at the faces rfom neighbor points. This cam 
improve. 


* 


) 


) 


) 


) 


) 


) 


& 
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Ny 


k integrand 
k integrand 


k integrand(0,:,:) = k integrand(1,:,:) 
k integrand(Nx,:,:) = k integrand(Nx-1,:,:) 
k integrand(:,0,:) = k integrand(:,1,:) 
k integrand(:,Ny,:) - k integrand( -1,:) 
(ie ( 
( ( 


k_integrand 


-0.5d0 « k integrand ! Remember the factor 
-1/2 before the Laplacian 
V * ( real(psi)**2 + imag(psi)**2 ) 1 Simply (Psi* V Psi) 


v integrand 


1 Integration of N, «K», «V» 
NofP = 0.0d0 
ExpectationK 0.080 


0.0d0 


ExpectationV 
do i=0,Nx-1 
do j=0,Ny-1 
do k=0,Nz-1 


NofP = NofP + 0.125«( rho(i,j ık ) + vho(i+1,j kK ) & 
+ vho(i,j+1,k ) + rho(i+1,j+1,k ) & 
+ rho(i,j ,k*1) + rvho(i+1,j rk ) & 
+ vho(i,j+1,k ) + rho(i+1,j+1,k+1) ) & 
* dx x dy » dz 
ExpectationK = ExpectationK + 0.125«( k integrand(i,j ,k ) + k_integrand(i+1,j 
ik ) & 
+ k_integrand(i,j+1,k ) + k_integrand(i+1,j+1,k ) 
+ k_integrand (i,j ,k*1) + k_integrand(i+1,j rk) 
+ k_integrand(i,j+1,k ) + k_integrand(i+1,j+1,k+1) 
* dx * dy * dz 
ExpectationV = ExpectationV + 0.125«( v integrand(i,j ,k ) + v_integrand(i+1,j 
ik ) & 
+ v_integrand(i,j+1,k ) + v_integrand(i+1,j+1,k ) 
+ v_integrand (i,j ,k*1) + v_integrand(i+1,j rk) 
+ v_integrand(i,j+1,k ) + v_integrand(i+1,j+1,k+1) 
* dx * dy « dz 
end do 
end do 
end do 


open(1,file-'psi.t', status-'old',position-'append') 
write(1,«) t,NofP,ExpectationK+ExpectationV, real (psi (Nx/2,Ny/2,Nz/2)), 
rho (Nx/2,Ny/2,Nz/2) 
close (1) 
end subroutine save_scalars 


subroutine save_axes 


use numbers 
implicit none 


integer i,j,k 


open (2,file='’psi.x’, status='’old’ ,position=' append’ ) 


write(2,*) '#Time=’,t 
do i=0,Nx 
write(2,«) x(i,Ny/2,Nz/2),real(psi(i,Ny/2,Nz/2)),imag(psi(i,Ny/2,Nz/2)), & 
real(exact(i,Ny/2,Nz/2)), real(error(i,Ny/2,Nz/2) 
end do 


write(2,») 
write(2,») 


& 
& 
) 


& 
& 
) 


& 


& 
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close(2) 
end subroutine save axes 


subroutine save planes 


use numbers 
implicit none 


integer i,j,k 


open(3,file-'psi.xy', status-'old',position-'append') 
write(3,«) ‘#Time=’,t 
do i-0,Nx 
write(3,xx) 
do j=0,Ny 
write(3,«) x(i,j,Nz/2),y(i,j,Nz/2),real(psi(i,j,Nz/2)),imag(psi(i,j,Nz/2)), 
rho(i,j,Nz/2) 
end do 
end do 
write (3,x) 
write (3,*) 
close (3) 
end subroutine save_planes 


Command of gnuplot that show results like those in Figs. 6.7 and 6.9 for the real part of 
W, the imaginary part of V, and p = W*W: 


gnuplot- splot psa ccv a) 30 P23) ev 222) tO Reps) we 

gnuplot- peus “js. sb 2 18 wees! ey Asa de "nme" vu db 

gnuplot> splot 'psi.xy' i 3 u 1:2:(3 * *2+4**2) ev 2:2 t ‘rho 
= Re(Psi)**2 + Im(Psi)**2’ wl 


For scalars like those in Figs. 6.8 and 6.10, for N, (E), real parts of ¥ at the origin and p at 
the origin use 


gnuplot» plot 'psi.t' u 1:2 t ‘Number of Particles’ w 1 
gnuplot» plot 'psi.t' u 1:3 t ‘Expectation value of E' wl 
gnuplot» plot 'psi.t' u 1:4 t 'Central value of the real 


part of Psi' w 1 
gnuplot» plot 'psi.t' u 1:5 t 'Central density' w 1 


Code [ Diffusion2p1.f90 ] solves the 2+1 diffusion equation with constant and 
variable diffusion coefficient in Sect. 6.6. 
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Author: Francisco S. Guzman 

Last modified: 17/february/2023 

Purpose: Solves the IVP for the 241 Diffusion Equation 

1 using the Method of Lines and RK3 

1 Uses zero Boundary Conditions 

! Case constant kappa for initial data of the exact solution 


! Case space-dependent kappa for an initial gaussian 
! Parameters to experiment with: change profile of kappa 
Output file: Diff2pl.t 

1 Output: t max (u) 


Output file: Diff2pl.xy 
Output: X y u 
! one data block per 0.01/dt iterations 


module global numbers 

implicit none 

! --- Numerical domain 

real(kind-8), allocatable, dimension(:,:) :: x,y 
real(kind-8) dx,dy,dz,dt,xmin,xmax,ymin,ymax,tmax,CFL,t,pi 


integer Nx,Ny,Nz,Nt,rk,ghost 


1 --- Primitive variables 
real(kind-8), allocatable, dimension(:,:) :: u,u p,rhs u,kappa 


! -- Some parameters of the equation 
real(kind-8) nodesx,nodesy,amp 


character(len-20) :: kappa case 


end module 


program Diffusion2p1 


use global numbers 
implicit none 


integer i,j,k,n 


! Define some parameter values 
Nx - 100 

Ny - 100 

Nt 100000 
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xmin = 0.0d0 

xmax = 1.0d0 

ymin = 0.0d0 

ymax = 1.0d0 

CFL = 0.125/4.0d0 

ghost = 0 ! 1 for periodic boundary conditions, 
pi = acos(-1.0d0) 

amp = 1.0d0 

nodesx = 2.0d0 

nodesy = 3.0d0 

kappa_case = ‘constant’ ! [ constant, tanh ] 
call allocate_memory ! Alocates memory 


! Numerical Domain 

dx = (xmax - xmin) / dble(Nx) 
dy = (ymax - ymin) / dble(Ny) 
dt = CFL » dxxx2 


do i=-ghost,Nx+ghost 

x(i,:) = xmin + dble(i) x dx 
end do 
do j=-ghost,Ny+ghost 

y(:,j) = ymin + dble(j) * dy 
end do 


print x, 'dt-',dt 


1 Initial conditions 


if (kappa case.eq.'constant') then 
1 For the Exact Solution with K-constant 
u = amp * sin(nodesx«pi«x) « sin(nodesyxpixy) 
kappa = 1.0d0 

else if (kappa case.eq.'tanh') then 


1 For a Gaussian and kappa - tanh function 
u= exp(-((x-0.5) **2+(y-0.5) **2)/0.05) 
kappa- (2.0d0«tanh((x-0.5)/0.05) +3) 

end if 


l! ----- Save data at initial time 
open(1,file=’Diff2p1.t’) 
open(2,file-'Diff2pl.xy',status-'replace') 

call savedata 1 Save data at initial time 


1 Evolution loop 
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0 for Dirichlet 


print x, ‘Iteration, time’ ! Send something to the screen 


print x, ‘0’,t ! Send something to the screen 


do n-1,Nt 
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t =t + dt ! Updates time 
|o*x**** cine LOOP CORE d 


1 Recycle arrays 
up -u 


DO rk-1,3 
! Calculate the RHS 
do i-1,Nx-1 
do j-1,Ny-1 


rhs u(i,j) - 0.5d0 «x ( kappa(i«1,j) - kappa(i-1,j) ) / dx & 
x 0.5d0 « ( u(itl,j) - u(i-1,j) ) / dx & 
+ 0.5d0 * ( kappa(i,j«1) - kappa(i,j-1) ) / dx & 
x 0.5d0 « ( u(i,j-1) - u(i,j-1) ) / àx & 
+ kappa(i,j) * (( u(i«1,j)-2.0d0«u(i,j)«u(i-1,j) ) / àxx«2 & 
+( u(i,j«1)-2.0d0xu(i,j)*«u(i,j-1) ) / dyx«2 ) 
end do 
end do 
if (rk.eq.1) then 
u- up + rhs u x dt 
else if (rk.eq.2) then 
u = 0.75d0 x up + 0.2500 * u + 0.25d0 * rhs u x dt 
else 
u = u_p/3.0d0 + 2.0d0 « u/3.0d0 + 2.0d0 « rhs u « dt/3.0d0 
end if 
END DO 


call Dirichlet BCs 
l! ***** SaS Ends Loop Core mm 
1 Save data every 10 iterations 
if (mod(n,int(0.01/dt)+1).eq.0) then 
call savedata 
print x, n,t 1 Send something to the screen 
end if 


end do 


close(1) 
close(2) 


print x, ‘Program_finished’ 


end program 
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subroutine savedata 


use global numbers 
implicit none 


integer i,j 
real(kind-8) max 


do i=0,Nx 
do j=0,Ny 
if (u(i,j).gt.max) max - u(i,j) 
end do 
end do 
write(1,«) t, max 


! 2D output 
write(2,«) ‘'#Time=’,t 
do i=0,Nx 
do j=0,Ny 
write(2,*) x(i,j),y(i,j),u(i,j) 
end do 
write(2,*») 
end do 
write (2,x) 
write (2,x) 


end subroutine 


subroutine Dirichlet BCs 


use global_numbers 
implicit none 


u(0,:) = 0.0d0 
u(Nx,:) = 0.0d9 
u(:,0) = 0.0d0 


u(:,Ny) = 0.0d0 


subroutine allocate memory 


use global numbers 
implicit none 
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allocate (x(-ghost:Nx«ghost, -ghost:Ny«ghost) ) 

allocate(y(-ghost:Nx-«ghost,-ghost:Ny-«ghost)) 

allocate (u(-ghost:Nx-«ghost,-ghost:Ny-«ghost)) 

allocate (kappa (-ghost:Nx+ghost, -ghost:Ny+ghost) ) 
( 


allocate (rhs_u(-ghost:Nx+ghost, -ghost:Ny+ghost) ) 


end subroutine 


Instruction of gnuplot to display results like those in Figs. 6.14 and 6.15 for u: 


gnuplot> set pm3d map 
gnuplot> splot 'Diff2pl.xy' i 3 
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